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' This lonognph speaks to the basic probleis 
confrpnting huian services prograis, and offers suggestions for 
iiproving guidance services. Specific concerns addressed are; (1) 
need for lore systeiatic prograi planning and evaluation; (2) an 
approach to effective planning and evaluation; (3) developient of 
staff skills for use in the planning^evaluation lodel and process; 
(U) strategies for. iiitegration of the lodel; and (5) a listing of 
additional reference laterials. 9here specific pr(>graas are 
discussed, contact naies and addresses are included so that the 
readers lay obtain additional inforiation* (CJ) 
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This chaptei: ilelineates some 5f the basic problems confrontliig 
human servlce3^iAI?8^d^ H^olted budget. Increasing demands for 
"results/' and'the lack of the necessary skills to Identify and 
effectively address student needs^ In response to these pressing 
problems^ ^ plan for the Improvement of guidance services Is 
Introduced. 

. ^ Chapter I 

The Need for more Systematic Program Planning and Evaluation 



Prdblemg^ In Higiian Service Prog rams 

* 

Human services programs have, reached a juncture In their devel- 
opment that Id at one and the sai&e time the most exciting ^d the 
most threatening they have ever faced. On the one hand^ the problems 

are more basic and critical than ever before. Clients are Increas- 

* 

Ingly facing an ever more complex world and looking to human services 



The work described In this document has been carried out at 
the Aioerlcan Institutes fox Hesearch» under aupport by the United 
Stated Office of Education^ Department of Healthy Educ^tion^ and 
Welfare^ under Part C of the Vocational Educ^^tlon Act of 1963. 
Points of view or opinions stated do not necessarily represent 
U.5.O.B. position or policy. ^ 
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programs and personnel for the help they need. Taxpayers are - 
watching their taxes rise and yet are seeing educational, decislon-r 
makers floundering for direction. As a result, they wonder aloud 
about just vhat they are getting for their money. Administrators 
are caught between these overtaxed, often hostile citizens^ and 
staff members demanding even more money for the very services that 
so often fail to satisfy the needs* Human services personnel 
themselves feel caught in the crunch ^ criticism descends upon 
them from all directions and they find themselves unable to justify 
their role in the terms inci^easingly demanded. And yet, with all 
of these pressures, human services programs seem on the crest of a 
golden age. The critical need for helping clients in the areas 
fraditionally coveted by such programs is widely apparent. The 
expanding responsibilities into new areas increase the possibility 
of ijtoviding truly enlightened^ meaningful learning experiences for 
clients. New and ifhaginative programs and materials are blossoming 
on all sides — resources to do the job so desperately needed. In 

short, the potential is unlimited^ if the problems can be solved. 

\ 

Zeroing In on the crux of concerns, sifting the bogus issues 
from the real^ identifying the exact factors to bilfrsolated wd 
dealt with first, is no easy job. But certain problems do stand 

Out* 

One problem that underlies not only human services concerns 

4 



but those of educational and social Institutions In gener'al Is the 
IncreaalBg budget ^tralns^ that hkve deve^opecf In recent years. For 



whatever reasons^ administrator^ ^are being fM^jed to cUt budgefts. 
In school settings, for example / high on most priority lists for such 
cutbacl^s are guidance and counseling "programs , Thl^ Is largely be- 
cause '*counse ling" somehow does not ha^ a clear etid proS'uct, or/ ^ 
seem particularly- Important ^ ^t least compared with teaching English 
or science, for example. How can aa administrator justify spending 
a sizable proportion of her or his budget on gtiidahce and counseling 
when s/he Is havlng*trouble paying for basic Instruction? 

.What this comes down to, and what seems to be at the heart of 
the problem today, Is accountability. How can those working In human 
services justify what they do, how they spend their time, where 
they allocate their resources?. How can they provide administrators 
* and (Citizens with evidence of their wortlf, demonstrate to them in 
meanlngf u!!|l, a^d dramatic terms ^he Invaluable benefits of their htjman 

services ^ogram?* Counsellors have done verv Uell in this area In tJie 
past, partly because counselo1^ educators hantre not taught them th^^^ 

skills. Candidates ^are steeped in the latest theories of behavior 

and counseling techniques ^ but left to their own 'devices when it 

comes tP justifying their role. 

Take, for example, a scene qccurring frequently around the 

country in school settings today. This Involves the prl^^lcpal 



but ^Jiose of educational and social Institutions In general is the 
Increasing budget strains that have developed iu recent years* For 
whatever reasons, administrators are being forced to cut budgets. 
In school settings, for example, high on most priority lists for such 
cutbacks are guidance and counseling programs. Ihis is largely be- 
cause "counseling" somehow does not have a clear end product, or 
seem particularly Important^ at least compared with teaching English 
or science, for exauiple. How can an administrator justify spending 
a sizable proportion of her or his budget on guidance and counseling 
when s/he is having - trouble paying for basic instruction? 

What this comes dcpwn to, and what seems to be at the heart of 
the problem today» is accountability. How can those working in human 
services justify what they do, how they spenJ their time^ where 
they allocate their resources? How can provide administrators 

and citizens with evidence of their worthy demonstrate to tlv^ in 
meaningful and dramatic terms the invaluable benefits of their human 

services program? Counselors have done v^rv well in this area in the^ 
past^ partly because counselor educators have ^not^"airgtTt--%t w^ t Ji e5g^^ 

^kilis. Candidates ate steeped in the latest theories of behavior 

and counseling techniques^ but left to their own devices when it 

comes to justifying their role. 

Take, for example^ a scene occurring frequently around the 

country in school settings today, Ihis involves the prinicpai 
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sitting down with the Dir€cto'?*of Guidance in the spring of the 
year to discuss the next year's funding. The discussions are 
usually quite* frank; the principal asks in very straightforward 
terms how s/he can justify the guidance budget for the next year 
given the shortages that exist. The response, when any is forth" 
coming at all, usually involves a recitation of all the innumer- 
able tasks a counselor perfo»* in a given day, from meeting with 
parents, to handling truancy problems, to referring students to 
othet agencies, to individually counseling students, to changing 
registration cards, ad infinitum , The weakness of this answer is 
that while It tells the principq^l what counselors ate busy at, it 
does not specify what they accomplish* Haw many students are 
different In what ways becauge of counseling? An<?wers to questions 
like this might make ari Ijopresslon, but few counselors know how to 
provide tiien, 

A fundamental pjrgf^lem Is reflected in the above 
description of the typical counselor's day. Going from task to 
task, responding to the greatest pressure of any given moment, the 
counselor ends up like a ping-pong ball, S/he goes from one crisis 
to the next, frantically trying to put out fires, with no time to 
sit down and consider the'' purpose of all the activity called crisis 
counseling, and it results in what might be called the sur^val 
syndrome for the counselor, The struggle is simply to keep one*s 



head above the water ^ to stay ahead of the next crisis* The prob- 
lem with this approach is that it results in a human services pro- 
gram that cons tant ly ^reacts to those who have reached the crisis 
stage t rather than acts to prevent such problems in the first place. 
Tht; alternative Is ^ program that depends on an organized plan of 
what each student should be receiving from the program as s/he 
progresses through school. Such a program^ while it cannot entirely 
ejliminate crises ^ can help to prevent them^ and at the same time 
cian reach out to all students^ providing help to those ready and 
able to groWt 

Such preventive and developmental programs can respond to 
another major problem: the growing demand to prepare students for 
the real world on their leaving school* In the past^ guidance pro- 
grams often coasted along by keeping a shelf of college catalogs 
and having a representative from the local smelting plant drop by 
in the spring for a talk. -With the career education movement^ sus- 
tained high unemployment - even in professional fields - and a growing 
student sophistication about school and the wor]d of work> this 
' approach will no longer suffice* Students want to know what is 
. going to happen to them when they leave school, what their oppor- 
tunities wiirbe. And they want to know how what they are learning 
r in school relates to -this approaching reality. Fulfilling this 
need for career development is another of the challanges facing 
guidance programs today. 
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This is not a complete summary of the* problems of human ser- 
vices programs, but it includes many of the key ones. Funding short- 
ages, lack of accountability, crisis orientation, and lack of 
career development are unhappy themes that pervade the majority of 
the programs today. If people working in this field could solve 
these problems, they would go a long way toward promoting general 
health and even buoyancy in the profession. Unfortunately, this 
is not presently happening. And it is not happening for certain 
identifiable reasons.' One of these is the "counselors cdtirtsel" 
syndrome . - 

This term refers to human services personnel's widespread 
feeling that they were trained to counsel, this is what they are 
good at, this is what' they enjoy, and this is damned well what they 
are going to do. matters little whether there are seven other 
activities that yill effect the same or better results in less time 
for more clien^. Providing instruction to large groups; employing 
and training peer counselors; referring clients ^o community agen- 
cies; supplying books and films in areas of general interest and 
need; organizing the program^so that^other staff members and para- 
professionals can perform certain^ functions — all these may be far 
more effective in helping large numbers of clients. But they do not 
provide the same kind of personal reward7'-that look of appreciation 
or ttiose ^grateful words from the one in need for the crisis resolved. 



f|uman services staff are well rewarded for Individual counseling, in 
very meaningful^ personal terms. But when this activity dominates 
their schedules^ can they legitimately claim that they ar€! helping 
the most clients in tKe most effective way possible? 

The reason for this syndrome* of coursei stems partly from r ' ' 
the education such persons receive. Individual counseling is 
usually what the^ are taught to do best. The same jeasOn helps to 
explain their generally ineffective response to the call for ac- 
countability. They do not know how to be accountable. Faced with . 
this situation^ many in the profession react with, at best, defen- 
sivenes€^ and at worsts out-and-out panic. 'Veil, what we've done 
in the past has worked pretty well up to now. Ihis n#w acqounta- 
bility fad will pass soon anyway, and we can get back in the old 
groove. Besides, aren't we doing anything right?" Unfortunately > 
things change^ and the good old past is in many ways gone forever. 
*\ccountability is not a fad; many experts suggest that the trend is 
just beginning. And while the defensive "Aren't we doing anything 
right?" response is understandable, it .will not solve the problems. 
Of course many things are being done well," But unless the activities 
that are not being done well can be improved upon, they may seriously 
impair the longevity of human services. 

Ttius, the funding crunch that education^ and. social agencies 
face, the crisis orientation of counselors, the counselors , counse 1 
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syndrome, the lack of career development programs^ the demand for 
accountability, and the lack of effective response to this demand, 
all add up to a serious situation* A solution is needed* If human 
services personnel could measure what they are doing, If^ given this * 
Information, they could then plan a developmental program that did 
provide all clients with career guidance^ if they could increase 
their effective activities and decrease their ineffective ones, 
(individual counseling or otherwise)^ if they could demon- 
strate the results of their developmental program, to those around 
them — especially those having, to ma^e budget decisions~a solution 
might be at hand. But who can do this? Unfortunately no ore - at 
least, not 'very well. Certainly not the typical staff member. Such 
skills simply are not a par t^ of traditional st&ff education programs. 

A Possible S ol ution 
Many ways to attack these problems and many possible solutions 
have been suggested^ ranging from fuller use of technology to dra- 
matic new human services techniques. One solution that is raising 
hopes draws on the research fronx a number of studies. For example, 
Califotnia recently surveyed its counselors to determine wWat were 
the greatest needs in the state, and concluded in A Plan for the 
Improvement of Guidance Services in California; 

Upgrading training for on-the-^job guidance specialists is a 
necessity for improving present guidahce services* Ihe majority 
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of those doing the job are now on the job and will be for some 
years. Improving the pre^ervlce training Is Important, but 
equally , . , Important Is the upgrading of those holdlng^ the 
guidance positions currently In' the schools, (Guidance and 
Counseling Task Force, 1973, p, 39). 



Similar conclusions were reached in a federally funded project 

conducted in 1972-73 by the American Institutes for Research (AIR) , 

This study^ Supported by the United States Office of Education (USOiO 

and designed to determine the adequacy of guidance programs for 

those students not going. to college, suggested; 

Comprehensive, well^-planned programs of In-^serVice education 
that focus on professional skills should be developed, and alX 
sdiool counselors should participate in them. Ihese programs 
should KeXp each counselor develop the skills s/he needs to 
meet revised certification requirements and to grow in competence 
so that s/he can advance professionally. These programs should 
be structured in close coordination with preservice counselor 
education programs that will result in concentrating on train-- 
Ing in competencies to bring about student outcomes, (Ganschow, 
Hamilton, Helllwel 1, Jones , and Tledman, 1973, pp. 5-24 and 
5-25.) 

Other studies have pointed in the same direction. And many of 
them reflect the stance suggested in the AIR study regarding the na- 
ture of the Inservlce education needed. Ihls type of training goes 
under various rubrics, including performance-based, skills-abased, 
competency-based, and so on* The key idea is that staff members need, 
to develop actual skills useful in on-the-job situations. Traditional 
education programs have often relied on academic, cognitive outcomes, 
turning out human service personnel who may know ^ lot but are iintest-- 
. ed in terms of actual performance. While general agreement has not 
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been reached on a precise deflnitlori for the term cootpetenq^-^based^ 
what does seem agreed on Is that such programs should go beyond 
cognj-tlve and attltudlnal levels and require , actual perf ordiances, 
- either In simulated or real-life situations, - 

Kow can competency-abased pre- and In-^servlce staff developmen 
programs solve the problems discussed earlier? Ideally, by showing 
those in the human services field how to plan and evaluate their 
programs systematically so thd^t'they are responsive to the pr(5blems, 
A well-planned, program can eliminate the/ survival syndronki^ and 
crisis orientation by requiring as the first step In the program i 
developmeac the mapping out' of a set of goals based on measur^ed 
client needs* It- can provide a way to measure the program's effec- 
tlveness by having ^these/goals translated Into behavioral objectives, 
with Information collected periodically to determine .whether these 
^ objectives have been a,chleved, it can courrteract the counselors-^ 
counsel syndrome b| determining which methods and activities are 
effective and by motivating staff to spend their' time according^ 
ly * Because such a progr^ operates from an overall plad of what 

clients need, a key part of this plan can be devoted .to their 

^ • -. 

career development needs. Since such a program can determine what 

It does and does not accomplish, It can be accountable; Given pre- 
^ • 

cl^e Information on what It Is doing for clients, how they ar^ ) 

o 

different because of Its' activities , It cmn muster very clear, 

I 
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dramatic arguments for coQtlnued funding, In summary, a competency- 
based staff deveiop!nent program designed provide hmnan services 
personnel with the skills needed to plan aod evaluate their progranis 
effectively could ideally solve every oae of the problems discussed* 

Presentiag the planning and evaluation approach developed by 
AIR (to be outlined and detailed ^Kere ) as an answer to all of tne 
above problems, however, is to misrepresent it. It does have clear 
advantages, no ita^er what the state of things - it was developed 
as a means of bringing fundamental improvement to human services 
programs regardless of the particular problems of the moment - but 
it is not a cure-^all, '^ne would have to be naive to expect to 
find the answer to every problem in any one approach. The following 
list sunm^zizest at least for school settings, some of the AIR 
approach's chief advantages and disadvantages from a standpoint re- 
n^oved from the Immediate problems such pro^tsms face* 

Advanta^es^ * 

It is a way to ' 

- get counselors ^away from^changing schedule cards, 
handling truancy problems^ doing ground duty, and the 
like, and iQto the important tasks for which they 
were educated ^ 



demonstrate to administrators, .teachers, students, and 
parents just what guidance departments accomplish, 

zero in on what students need aod want, and know that 
what is being done is important. 
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" nionitorlng quality of a program and nake sure it 
is accomplishing what It is supposed to do*- 

- nove counselors fron ^'people who like to rap" to 
effective changers of behavior. 

" clean the cobwebs 'out of a- program, ellirinating 
practices everyone knows should have been stopped 
five years ago, seek newer and better ways of ac-- 
c:>apllshing ends, 

- bring a department together under a comnon 
philosophy and agreed upon goals, 

Disadvantages , * ^ 

It is disadvantageous in that: 

' - staff members are likely to see It as a response to 

outside pressures for accountability which they resent v 
$nd opapse , 

- it requires a great deal of hard work, 

" it involves the use of student behavioral objectives, 
which can be frustrating* 

- It'm^y well reduce the amount of time counselors 
spend "'counseling," an activity most are fond of, 

* it has a certain research feel, use^ a systematic 
approach and terminology which may seem foreign, 
and will require a genuinely open mind and a ^ 
willingness to try something nev, ' * ^ 

- it requires change, which presupposes both an 
individual and institutional commitment to change^ 
and an atmosphere free to allow change. 

- it offers no flashy new counseling techniques, simple 
cure-alls t or easy shortcuts* Primarily it is a way of 
organ! zing , programs so that they can'bfe effectlvej 
efficient^ accountable^ and responsible to students. 
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It should also be added that AIR no, exclusive patent on 

this approach/ Operation Guidance<^developed at Ohio State ^niyer- 

/ > 

sity under the direction of Robert Campbell and Harry Drier^ paral' 
lels it very closely (tamp^ell, 1972), Part of their project in- 
cludes the Career Planning Support System, a comprehensive appit&ach 
for assisting high schools to upgrade their.career guidance prc- 
grains. It is currently being f ield-^tes ted in Welve states, 

AIR has beep working over the past two years to develop a 
system of cotnpe tency-based staff developraent to provide practitioners 
with the skills needed to carry out such an approach ^ and this ven- 
ture may represent something of a breakthrough; but the concept it- 
self has been expressed by nuzoerous experts, and it would be unfair 

to represent it otherwise • 

I 

Overvie w of Remai ning Chap ters 
To suiiimari2:e, we have now detailed some of the problems ^to 
which this approach can respond, and have delineated some of its 
strengths and weaknesses* What follows Is a description of exactly 
what is involved in the approach (Chapter ll) , how the staff develop- 
ment program developed at VtR furthers the skills- needed to imple- 
ment it (Chapter III), and how some of the new client strategies 
.and materials available on the market can be integrated into a pro- 
gram using the approach (Chapte,r IV) • Chapter V provides a brief 

recap, and the document then ends with a bibliography of books and 

f 
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materials related to the topics^ or de tailing mdterials^ available 



to be used vith the approach* * Chapters II*-IV perhaps require a * 
little further illumination t 1 

Chapter II, 'An Approach to Effective Program Planning and 
Evaluation," first overviews the entire planning and evaluation 
approach proposed here. It then concentrates on the ^i^tst foui? 
parts of that a|>proacht 

1. Conducting desired oujcoines assessments. This Includes 
designing assesgments , selecting samples, developing 
instruments, administering instruments, and summarizing 
and translating d^a into desired program outcomes. 

2. Conducting current status assessments* Touched on here 
are summarizing program resources; analyzing current 
goals f effo|:ts, and outcomes^ and determining the current 
status of clients in the program. 

^ 3* Establishing program goals. 'Ihis involves comparing the 
results of 1 an<i 2 to determine the discrepancies between 
the ideal and the current, drafting goals accordingly, 
and classifying ^d prioritizing goals, 

4» Developing client performanc^ objectivesi An easy straight 
fo^rtfard means of establishing a set of prograin behavioral 
objectives is de tailed ^ .inc luding both the drafting and 
sequencing of the objectives. 

ffach of the sections selects and sumarizes one key activity from 

each of these parts and includes examples of instruments and/or 

products . 

Chapter III, 'Developing Staff Skills for Ihls Planning- 
Evalu^tion Model and Process," details the staff development approac 
that has, been developed. Ihi5; chapter diequsses the philosophical 
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basis for the dpprodch and some of the central definitions impor- 
tant to it; the focus of the approach itself; how it fits witU-the 
planning activities detailed in Chapter 11^ as well as with general 
human service skills; and then the nature of the staff developiDent 
materials themselves » including; 

Intended taf^et audiences' 
' ' . ' - JExample objectives of the approach 

- Format defini'tlbris 

- Sections of the iDaterials 

- A discussion of tryouts to date 

Tne chapter concludes with a discussion of some of the problems' aod 
issues involved in impleinenting this staff development approach » such 
as motivation of partidpants, sequencing the various tasks^ coping 
with negative attitudes tcvard evaluation, finding ways of measuring 
improvement in participant skills^ and making it appropriate for 
preservice as well as inservice settings. 

Chapter IV, 'Using Competency-Based Client Strategies and 
Materials/* explains how client materials and programs can be inte^ 
grated with the above planning-evaluation model and the staff de- 
velopment approach; It overviews^^^^ent developments in client 
programs » and provides a synopsis of a number of promising ones now 
available. Details on each program include an overview, its basic 
goals and objectives ^ procedures and methodology^ any evaluation 
information available, and a.^ontact name and address > Programs^ 
touched on will include Hunan Development Services' Lifa Career 
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Development System ; the College Entrance Examination Board's Decisions 
and Outcomes ; the Agency for Instructional Television's Bread and 
Butterflies ; the University of Missouri's Car eer Guidance^ Counsellngj 
and Placement Guide, and Career Education Methods and Processes ; the 

1 ^ -m i. , w n ■ -V ^ ■■■ * - 

Federation of Rocky Mountain States^ Caree r Education and Satellite 
Technology Deiaoas tratt cn; the Baltimore Public Schools' Baltimore 
Placement and Follovup Prx>gram ; and the ClevelaiK? PUollc frchq^ols* Job 
Development Program . 
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The systematic model and process that the authors >r6codmend 
for effective program planning an(| 'evaluation Isflntroduced 
here- ^Following a brief presentation of the'^omplete mpdel^ 
one fundamental segment of It Is described in ^ore detail-* * 
The following Sets of activities comprise this segment: 
conduct:lng desired outcomes assessirfents ^ performing current' 
status assessments^ establishing program goals, and develop- 
ing client performance pbjactlves. <Each of d>ese sets Is 
summarized^ and the tasks* and products InvoIvedT In one of 
Its essential activltlea are reviewed In more detail and 
1 Ilustrsted - * * _ 



Chapter II 

An Approach to Effective Program Planning and Evaluation 

Overview of the Com>Iete Process 
As noted In Ch&pter I, the program planning and evaluation 
approach on which we at AIR have been working ovfer tjie relcent years 
employs a systematic model that Is based on scientific methodology 
and is aimed at the planning^ development, Implementation, evalua- 
tion, and revision of human service programs. It focuses on the 
needs and characteristics of children, youth ^ and adults. This - 
learner-based orientation means that the approach assesses needs 
of learners and. translates them Into measurable objectives. It Is 
upon these needs and objectives that priorities for human service 

In^etventlons ar^ based. Featuring a process In which each phase 

i 

provides feedback to preceding phases. or Input to subsequent actlv- 

\ 

ities, this method assures that the genuine deeds of Vour program 
recipients or consumers will be met in the order of their importance, 

I 
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The systematic model and process that the authors recommend 
for effective program planning and evaluation Is Introduced 
here. Following a brief presentation of the complete models 
one fundamental segment of it is descrlbejd in more detail. 
The following sets of activities comprise this segment: 
conducting desired outcomes assessments > performing current ^ 
status assessments I establishing program goals i snd develop- 
ing client performance objectives. Each of these sets is 
summarized, and the tasks and products involved in one of 
its essential activities are reviewed in more detail and 
illustrated. 

Chapter II 

An Approach to Effective Program Planning and Evaluation 

Oyy rvlew^ of the Cppylete P rocess ^ 
As noted in Chapter the program planning and evaluation 
approach oh which we' at AIR have been working over the recent years 
employs a systematic model that is based on scientific methodology 
and is aimed at the planning, developinent, implementation, evalua^ 
tion, and revision of human service programs. It focuses on the 
needs and characteristics of children, youth, and adults, Ihis 
learner-based orientation means that the approach assesses needs 
of learners and translates them into measurable objectives. It is 
upon these needs and objectives that priorities for human service 
interventions are based* Featuring a process in which each phase 
provides feedback to preceding phases or input to subsequent activ- 
ities, this method assures that the genuine needs of your program 
recipients or consumers will be met in the order of their importance. 
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This systematic approach contrasts with typical programs, lii/whlch 
certain Impoi'tant phases (such as evaluation) are often omitted or 
others (such as Implementation) are overemphas'lzed. 

The model Is goaltr*orlented and designed to, achieve clearly 
Identified and, 4f possible, measurable objectives. The focus of 
the model is continuously on achievement of objectives. What is 
done, how it is done, and its succees are all deteinniaed by these 
objectlve&t Feedback tells you, the program , planners , whether to 
change your methods or to change your objectives, 

Iti ^Is approach to delivering human servloes, your program 
staff spends time seeking answers %o the following questions; 

1* )^at do we accomplish? 

2, What do we not accomplish? 

3, What should we want to accomplish? 

4, What can we do to accomplish it? 

5, What is the best way for us to accomplish it? 

6, Did we? 

For the purpose of simplifying coimnunicatlons » the model on 
which this program planning and evaluation approach is based is 
divided into four phases or groups of activities. We are reluctant 
to identify specific categories or to use the word ^'phases" because 
as soon as they are define'd and even diagrammed in some type of 
linear order, it becomes too easy to think of them as having to 
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occur In a lockstep^ chronological sequence. This then distorts 
the vfhole dynamic, and cybernetic nature of the Interaction of thoje 
Inactivities and their effects,. Hopliig that this warning Is suffi- 
cient, we fall back on the easiest way we knov to couHnunlcate this 
model In. writing — a' list, more dQtalX^ descriptions, and a'<Jlagrain 
of the phases , ^ ^ 

i - I 

* The phases are ; 

Planning ' determining what you and your cohpumers want 
to accomplish and Integrating this with system or 
, Institutional needs. 

Developing ; Identifying and putting together the best 
ways to accomplish what Is desired. 

Implementing : putting yoyr plan Into action, trying 
out your selected activities. 

► Eval^ ati n^ (Impactj^^ ao d. Deciding : fl/idlng out how well 
It works' and what do next. 

The first phase. Planning, 1$ largely a data-gathering one. 

Many human services programs rely on Insubstantial guesses and as- 

sjimptlohs about what they dhould be doing* This phase systematically 

entails defining a philosophy, assessing the desired outcomes of 

your program consumers, determining where your program Is at pre- 

sent, and then, based on these data, determining needs statemeifits 

and establishing a workable set of program goals. The program moves 

to a far firmer base, founded on comprehensive data and thorough tinal^ 

ysls. 
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In graph form, this phase may be represented thusly; 



Defining Hainan Development 
Theory and Basic Assumptions 



I Ass 



sessing Desired Outcomes 



-1 



Assessing Current Status of; 



.a. Program resources 

b. Allocation of resources 

c. Current status of 
program consumers 



EstabIishl^^g Program Needs and .Goals 



Having completed the Planning phase of your pj^Pgram improve- 
ment cycle, you will have established a comprehensive, practical 
set of goals, based on solid data and Intelligent analysis. But 

■ n 
4 

these goals will be global, abstract statements which will fail to 
Indicate exactly what your program consumers should be able to do. 
And they will say nothing about how you may expect the program to 
help learners to accomplish such specifics. The tasks of this second 
phase. Program Development, can be graphically illustrated as follows 
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jProgram Goals 



Exfflgp le 

To help s^tudents increase their 
knowledge of the world of work. 



00 

c 
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iSpeclfylng Human 
iperformance Objectives 



All fourth grade students ^wll 1 
be able to provide three sen- 
tence definitions ot five occu- 
pations on a test In class. 
All eighth grade students will 
write one page summaries of their 
visits to five places of work 
satisfactory to their social 
studies teschers. 



Selecting Alternste 

Program Strategies Have students; 

1. Visit several places of work 

2. Read books » articles 

3. View appropriate films 

4. Do Individual research 

y 

As the name suggests^ the tiext phase ^ Implementing^ gets Into 
the nuta and bolts of actually dolrig what you have been planning and 
developing* Each of the strategies wlll*lnvolve many Individual 
tasks for the program staff and these may be thought about bxA plan- 

neji in advance. The staff will probably be able to perform the 

I 

vast majority of these^ but yoa may have selected certain desirable 
strategies that will require further development of certain staff 
members. And as you go along^ you will jjndoubtedly have to go through 
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a fine-tuning process with new programs and strategies to work out 
the bugs and make them as effective as possible,. Each of these 
topics Is treated In this phaae. 

Again graphically; * 



Specifying Process 
Objectives 
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c 
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Developing Progri 
•5taff 
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Trying Out Activities 
^d Monitoring Early 
Impleinentat^on Efforts 



, In a sense ^ the fourth phase of this systematic Approach brings 
you full circle. You began by gathering Information to make Intelll; 
gent planning and development de^^clslons. Now you need to gather 
Information 6n how well you have done. By doing this Intelligently/ 
you can then make furtlier planning, decisions and create a process 
of constant Improvement. 
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Graphically ; 



Conducting Sutnmatlve 
Evaluation (Cost-Impact Stydlea) 



Communicating Bvffluatlon 
Results and Making Decisions 
for Subsequent Programs 



Ihe above phased comprise the overall model and procead on 
which we at AIR h^ve befenvorktng. Flgurar 1 on the next page llr- 
lustrates the interacls^^ of these four phases. The total mod 
provides a Vay to develop and 'operate human service programs logi-- 
caliy and systematically which has been shown io be very helpful 
In many situations*. But the system Is not perfect^ and It does not 
remove the need for h^rd work,. 



i 



23 



For you to understand and experiment with the plannlngi- 
evaluation approach^ you would need Hjuch mpre Information than 
is provided in the brief descriptions and' figures presented in 
th^ preceding section. A detailed review and illustration of all 
four phases of the model is not pcfesible in, this monograph. More 
feasible Is coverage of one segiiient of the model ^ and this will 
be attempted in the remainder of this chapter. Discussed here 
will be the Planning Phase (except the Important activities of 
defining human development theory and assumptions) and a key acti- 
vity of the Developing Phase^ ^specifying human performance objec- 
tives . 

w 

Examples of / P efiired Qu t comes Assessment Activities and Products 
Once a prb^am's basic philosophy has been definedjj the next 
logical move is'to establish its ^oals and objectives* Tts^^^Jceytj^ 
such foundation building is identifying the important needs M that 
program's consumers. Human services are often structured around 
system needsi Needs assessments should giv^ primary attention td ^ 
the need/ of the recipients of those services and should encourage 
the adaptation of services to people, rather than vice versa. They 
can also supply comprehensive data for determining the accountabil" 
ity of human services prograi^; give concrete, empirical data 
around which to develop programs; provide comprehensive data Instead 
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Define Phjlosophy. Pu*"- 
p03es :nd Target OrouO* 

As5e^s Current Cofitext 

Assc^ss Desired Outcafncs 

I^Ionttfy Progron* Needs^^ 
Writ* Goal Statements and 

"^Atfe and Svoluale the 
Planning Occ^siont and 
Activities 



portent 
Evaluation 



Specify Intnedidte Program 
t-drticipjnts ir4 
D'^jOLtwes 

Itfve"ii1*ite> Soiectj anU 
Structure Progn^n 
Procedures 

' Comi'jnicate and Evaluate 
Profjra*^ Structuring 
0?C»S*OHS ^tld ActtVtti**S 



Evaluation 



"T 



Implementin g 



^tate i^racedural Objoo 
txvr'^ and Itrplerentition 
^ira;o<;ies 

Velcct Pro^/'^an ^taT^ ani 
initutc St^Wf r^e^^el'-p-^ent 
Attwitit;! 

r*-(_'p3*^ ,"iL>Td Test SUc^ 

C(V"ir;.i;cJte; Co^d^jct, 
vH*:por: arsd Apply the* 
ftC^XjitS of Process 
Lvaiuattons , 



Process 
Evaluation 



Ir/:^.^Ot rval'jbttnq and Decidi:^^ 



Ce'S^O'^i conduct, tn^ rep'ir; 
frtxJjct '?val\;atior.s 

'ciVrpire ccst^* relate 
^osti to o'^'ects arc ^j-* 
niruj a-d tt:^oir/~co7t* 
effeciUencss rallies 

^esiq*^, cond^*ci, repo^^t 
^tJ^^l *j ;*iat i^»n.!.i^y the 
nt>st j;i-tf f ic^ou: cro* 
iL->*Juret or^grdr*^ 

design, CM^.d-^ct, rep^ri 
v.o^^t'bcn^'it :tudies 

'^^e dec;jio^s related to 

•nj :hjof2s in f»ei(J- 
*.e^t«^l 'Drogrjrs; co-i- 
(ijnic*ite these decisions 
>ind thefr ratforale , 
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SuT»'ratl ve 
tivoluation 
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Feedback Eval u i'on ^in'^i'^*^' 



Qf ieolated guesses; lijcrease program coordination; and initiate 
a process of planning and evaluation designed to keep programs 
current • ' ' 

To conduct such needs ^seseSietrts requires 'asking program con- 
suners as well *s other knowledgeable persons^ to indicate their 
thoughts and feelings about what they need, A major part of the 
total .Q^eds assessment process Is the assessment of desired outcooes. 

The process may be broken down Into a number of activities: 

f 

1* Designing the assessment, 

2, Defining and selectl^ the persons to be sacopled In the 
assessment* 

3* Selecting /developing the InstnimentCe) , . 
4, Administering the Instrument (s) » 

5* SussBarlzing and translating the data Into desired outcacies* 
We have selected the third activity to discuss and Illustrate below, 

Selecting/Developing the De sired Outcomes Assessment Instrmaent(s) 

Many different approaches to the development of Instruments are 
possible, ^Jba^^^^i^aslc question Is probably whether you want to 
use an already existing vehlQle or develop your own. In either case, 
a variec assortment of approaches is possible. The following dis- 
cussion presents a synopsis of the various kinds of Installments 
available for your use, 

. Klnds ^ of Ips tnapents, a. Observational techniques. This method 
of collecting information Involves watching behavior and tabulating 

I 
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da WwfiP ^at is seen* Usually such information is collected in 
real life settings with the observer acting either as a participant 
(a group facilitator noticing group loembers' nonverbal responses 
during a group^ counseling session) or a nottpartlcipant (a child 
therapist using a ona^vay mirror), 

b. Intervievs. In this technique the information gatherers sit 
down with the individuals from whom they wish to obtain information 
and ask them questions in a face^to-face setting. Usually they 
work from a predesigned form or set of <^uestions to try to assure 
eqtial treatment of all interviewees. The fac^-to-face contact and 
personal touch are advantages of this approach^ but it is usually 
titiSe- consuming and may contaminate data through personality variables 
that come into play between the two (or more) people. 

c. Questionnaires. These are paper-and^pencil instruments to which 
individuals^ respond in any of a variety of ways* These include 
written responses to open^-^nded questions^ checking *^yeB'^ or "no/^ 
checking one of several multiple choice i^spons^s^ ranking a series 
of statements from highest to lowest^ and rating statements along 

a numerical or written scale* Questioonaires are widely used be- 
cause of their efficiency and ease of administration* 

d. Follow-up studies* These are surveys of individuals ncv re- 
moved from a program^ such as graduates from high school who are 
asked for their thoughts on a high school career guidance program. 
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A fairly short structured or open-ended questionnaire Is frequently 
employed^ but an interview forntat can be used. Mailing strategies 
often play an important role In this kind of survey > and aehlevlng 
a high level of response le roost important, 

I 

.e. Card sort techniques. This is a hybrid of the Interview and 
questionnaire In which individuals can be given a "decf of cards, 
each with a statjement relating to an outcome they might deslpe In 
a common area. Individuals sort through each deck they receive, % 
eliminate those cards which do not represent desired outcoiaes for 
them^ and arrange those that do In order from most Important to 
least. When data on the desired outcomes of Individuals are com- 
bined^ the areas of highest choice and the highest choices within 
each area can be established. 

f. The critical Incident technique. Critical Incidents result 
ft-om the observation of Identifiable behaviors that have a clear 
Intent or purpose and ^t least one observable outcome. The inci" 
dents reported are of critical importance to the achievement of 
the outcome or to the lack of progress toward It, In ooe Instance^ 
critical Incidents relating to ten abstract goals we^re collected 
from parents^ teachers^ and atudents > allovlng precise behavioral 
definitions of the goals both l^ferms of student behaviors and 

teacher strateglas-tu eacoOrage such behaviors. A classification 

i 

scheme was then built for each goal, and ^ series '^Sfv^needs-aescssr- 
nent*' questionnaires was developed to determine the extenV^to 
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tfhich appropriate' student behaviors vere being demonstrated. Ihus, 
the critical incident technique served to define, in behavioral 
tems, the desired outcomes of the educational system* In another 
case^ critical incidents vere collected on counselor communication, 
responses thit vere either effective or ineffective in facilitating 



client progress. These incidents verQ» used to identify competencies 
around vhich a counselor education program vas later designed. 

g. The delphi technique. Ttris entails a series of intensive in- 
terrogations of samples of individuals (most frequently experts) by 
m^ans of mailed questionnaires altbed at ranking desired outcomes 
and arriving at goals r The mailings are interspersed vith control-^ 
lecT^eedbaclc to the participants. Responses to each mailing are 
summarized and returned to respondents anonymously* Competing 
opinions usually converge and diverse opinions are often blended 
into distinct and clearly stated majority and minority opinions* 

Existing Instru me nts * Wh-at often seems like the easiest vay ^ 
out of th^ confusion of finding a good instrument is simply ^6 
adopt one. that is generally available and thus mak^^tjtg^ of someone 
else*s expertise^ You are saved the vork and ^itpense of generating 
your own^ and a ready-^ade instrument j^^uT^^seem to provide the 

simplest solution. Unfortunately, the solution is not that e^y 

y' 

. ^ 

because a number of^ problems are involved^ 
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The fIrBC difficulty Is Chat In moBC cases such InBtrumenCB 
have not undergone the kind of testing and refinement necessary to 

t 

'^hone them Into reliable, trustworthy vehicles for your purpose. A 
second problem is the fact that no matter how good the Instniment, 
tt will rarely lend Itself perfectly to your particular setting - 
and will have limited generallzablllty since It was designed with 
the ne^ds and conditions of a different locale In mind* A third 
problem Is that few existing Instruments make the distinction that 
we advocate between desired outcomes and current status* in an 
assessment^ unless a program has Information both on where It should 
Ideally be and where it currently Is, It Is operating on very In- 
adequate data* Most Instruments just start asking questions, Ig- 
noring this distinction, and wind up with a potpourri of Information 
that Is of dubious value* ^'^-u^J^ 

In mentioning some of the Instrtunents already In existence, 
therefore, we dlso caution against blithely adopting them. Either 
adapting them or using them for Ideas In generating your own In^ 
strument Is usually a better course* Only those Instruments seeking 
at least some desired outcomes Information are listed below* 
a* Priority Counseling Survey* This multlple^cholce questionnaire 
(Smith and Johnson, 1971) seeks a mixture of current st^atua an3 
desired outcomes Information reported by students at various aca- 
demic levels; separate fotin3 are available for junior hlgh> senior 
hlgh^ ^d college respondents* 
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b, MlaBourl 9t^dea^ l^eed^^Survey ^ This broad ranging Instrument, 
with variations for students, teachers ^ parents, and employers » uses 
a multiple-choice format, aeetlng a mixture of current status, de- 
sired outcom^, and evaluative Information, It Is available from 
tlie Missouri Stste Oapsrtmentjof Education, 

c, North Dakota Ke^c^ Ags eamiie nt Model , This slX"polnt rstlng 
sQ^le survey has varlstlons for students, teachers, and admini- 
strators. It clearly separstes students* responses Into current 
status^^dl^d^ desired outcomes cstegorles^ while seeking current 
status Information from other groups, Ihls survey Is svallable 
from the North Dakota State department of Education, * 

d, Sants Clars Count y Educational Meeds Su rvey , This rating scale, 
survey seeks^ s tudents * feelings about where things are ^d where 
they should be, also trying to determine In what^areas schools should 
help students. It Is supplemented by a teacher assessment. This 
survey was , developed by the Santa Clara Office of Education In San 
Jose, California, 

Developing Tour (km Ints^rumenC^^) ,« Because not all the tech- 

■■ ■* I » I IV ^ -r^ A"* t 1 ■ » 
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nlques listed earlier can be dealt with In detail, we wlil concen^ 
trate here on ques tlonnalres ^ as they seem to be the most generally 
practical* A number of questionnaire formats Is possible. One Is 
^he open-ended written response. In which the respondents tell in 
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b. Ml88ourl St^iie^t^tee^M Sxtvyey , This broad ranging Instrument, 
with varlatlonsT^ for students, teachers^ parents^ and employers, uses 
a multiple-choice format > seeking a mixture of current status* de- 
sired outcoae, and evaluative Information. It Is available from 
the Missouri State Department of Education* 

c* North Dakota Hee dg MyegOTte nt Model . This slx-polnt rating 
scale survey has variations for students^ teachers , ^d admini- 
strators* It clearly separates students' responses Into current 
status and desired outcomes categories, while seeking current 
status Information from other groups. This survey Is available 
from the North Dakota State Department of Education. 

d. Santa Clara C^punt y Educa^tlonal Needg_ Su rvey . This rating scale 
survey seeks students' feelings about where things are and where 
they should b»^ also trying to determine In what areas schools should 
help students* It is supplemented by a teacher assessment. This 
survey was developed by the Santa Clara Office of Education In San 
Jose, California. 

Developlne Your Own lMtnjmettt>(ft) . Because not all the tech* 

— — "'"^ M 

nlquea listed earlier can be dealt with In detail^ we will concen- 
trate her^ on questionnaires » aa they seem to be the most generally 
practical* A number of questionnaire formats Is possible. One Is 
the open-ended written response^ In which the respondents tell In 
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their own words the answer to a question^ structure their responses 
in the manner which is im)st meaningful to theiOi and offer individual 
insights. This format usually causes difficulty in summarizing the 
information^ but does allow for individual expression* A second 
format ^sks respondents simply to agre^e or disagree with statemen^s^' 
which express opinions on various aspects of the survey *s subject. 
In a third kind respondents are given multiple choice items and asked 
to pick" the ones that come closest to their view, A fourth format 
is that of ranking^ in which various desired outcomes are listed and 
respondents are asked to put them in the order of their Importance. 
A fifth format entails ratings, in which respcmdents express on a 
series of scales their feelings about the questionnaire's variables. 

A~ number of guidelines &hould be kept in mind if you choose to 
develop a questionnaire. Begin by choosing the format that seems 
best for your purposes^ and then write a sample set of items and 
have them evaluated to make sure they are appropriate and function^- 
al. To be useful as guides to program improvement ^ each item 
should reflect a change in behavior, an attitude, or a level of 
knowledge- Items must be meaningful to the respcidents. Language 
and wording should be appropriate to their age, grade, levels or 

experience. 

In addition, items should reflect the real needs* of , the re^ 
spondents and not ignore Important problems « Items should be ones 
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to which th«y would be willing to respond^ and should encourage 
response. Respondents should not feel threatened by the atatementg. 
Your directions should make It clear that there are no right or 
wrong answerst y<>ur statements should reflect this orientation. 

In addition to writing the actual Items^ you will naed to 
draft some direction to go with thern^ Agaln^ sone general gulder^ 
lines apply. Firsts the directions shquld be as, brief and to the 
point as possible* They should explain' th€ reason for the Instru* 
ment and what It Is to do. Be vei^ concrete In this regards With 
questionnaires t If Items areVto be(checked» say slo; If clrcledt 
indicate that; if written out^ X^d^cate the length and form (sen- 
tencet. phrase^ list) of response you want/ Often it la useful to 
include a sample item or^twot with the correct form or response 
clearly demonstrated. If there are time limitations or other per- 
tinent c<M^ditions which ^ply to administration of the Instrumentt 
be sure to mention these so that respondents can take them into 
account * 

Once you have generated a number of items^ you should pilot 
test them. If you try them out on fellow staff memberst you will 
often receive valuable suggestions for improvement. Along with 
thist and more importantt the items should be tested with a f«w 
of your program counselors who are comparable to those to be in^^ 
eluded in the assessment. Suggested improvements should be gathered 
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directly from these people and from observing how the process goes 
and what the results are^. Suggested changes can then be made and 
the final Instrutoent drafted. 

Examples o f Current Status Assessment Activities and Products 
Once the de s 1 rtS^'ou t cSh^s^-'are defined, you will have deter- 
mined the Ideals toward which Vour human services program will work. 
But also Important Is knowing where you are at pi^sent. By com- 
paring these two situations* you can determine just how far you 
have to go. Using these concepts, then^ we define need as the dif- 
ference between the current state (or status) and the desired 
State (desired outcomes) . Graphically : 



Need 

Curreat S^tatus Deslrp d Status 



A current status assessment Involves gathering Information 
through these kinds of activities: 

1. Summarizing the resources available to your program. No 
matter how many desired outcomes have been defined^ a real- 
istic program must to deslgned"->one that can be carried 
out with available resources. 

2. ^Analyzlng Kfew \^iese resources are presently being used. 
Since the most\x^portaDt resource Is usually staff time, 
some measurement of how this Is being expended Is central. 

3. Me^fiyrlng how weU "program conat'umers can do presently In 
the areas on which their program will focus. These data 
can then be compared with ±helr stated desired outcomes to 
show where the l«gest\dlsxrepencfes exist. ^ 




Because the second activity Is perhaps the nfost dlfflcult^of the 
above three, It has been selected for further discussion /aid lllus- 
tratlon. In a-ll of these activities It Is Important to* note that 
a current status assessment Is not 'designed to evaluate. a human ser- 
vices program^ You will not be determining If a particular program 
Is good or bad; you will merely find out what Is happenings 

Analyzing Qirrent Allo cation o^f Program Re sources 

One obvious way of determining current goals and efforts of a 
human services program Is studying available documents^ \ These will, 
of course^ Vary from one social action setting to another, but the 

4 t 

following current dpcumentis are possibilities for st^udy. 

1. Statements of program objectives, desired outcomes. If 
the objectives have been documented for the programi they 

* ^ can serve as points of reference! As discussed above, a 
current status assessment Is concerned with *what the pro-- 
gram Is trying to achieve ^ . 

2. Program consumers' records. Records will not be the same 
for every setting, dut such Inforinatlon could li}clude stan- 
dardised test scores^ referrals to counselors', interview 
reports, academic records^ attendance patterns, and demo- 
graphic Information. 

\y* Fottipw-nip studle^Sj Studies of graduates and other former 



clients can provide Information.^ to the respondedts * 
perceptions of the progt'am and how Its activities have ^ 
assisted them or failed to help. ' * - 

^* Research or evaluation studies^ If the program has recent^-^ 
ly undergone an accreditation or beeh the object of re- 
search, the resulting d4ta may provide Information that 
pan be utilized* 
5p ^ Departmental budgets* These should provide all of the . ' 
Information you need to determine the allocation Of your 
financial resources,. 
6t Community surveys. Studies may be available that show 
what occupations are most common In your area aitd what 
Vocational at^d educational opportunities exist* Other 
studied may offer reports from local employment agencies 
regarding their perceptions of your program^s graduates 
and their career or life preparation^ 
None 6i these six potential sources of Information Is going to sup- ^ 
ply the answer to questions regarding the current status of your ' 
program* Infonnatllin must be gathered from a number of soyrces and 
analy2:ed as to its appropriateness and usefulness^ 

In addition to studying. available documentation, another Infor- 
mation gathering method entails conducting tlme/taak/cost analyses. 
Because In a current status assessment one of your concerns' Is the 
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way reeoursee are Uded# .a tlipe/task/coet analysis can^be a useful 
approach. This analysis consists of noting the various tasks *and 
activities performed by a program staff member^ recording tiie a- ' * 
mou^t of time spent on *each one^ and finally calculating the cost' 
of each task on the basis of^ time spent. The record*^keepln^ may be 
done by the person performing the tasks or by a trained observer. 
The results of the analysis Indicate the tagks ^^^ormed^ the length 
Qf time they took^ and the cost of each tc 

, For example^ to determine the cost ofc an^ activity that re-^ 
quired x hours of a counselor's time, this) formula can be used: 
Cost of counselor's ^ Weeklj^ sa lary 




time per hour Hours worked per week 

Suppose Counselor Davis gets an annual salary of $12^000 and works 
40 weeks per year. Each week s/he works from 8;00 A,M. - 4:G0 P.M. 
less 1/2 hour for lunch and two 15-mlnute coffee breaks. For each 
hour of his/her time, the school district pays 

Weekly salary ' = ^^^l^^ * $30p 

Hours work/week -35 

» $8.57 Salary per hour 

Thus, If Counselor Davis Is spending an average of 2 hours per day 
on clerical 'tasks, the cost to the school each day Is approximately 
$17. 

A tiiTje/task/coet analysis might also be made of other human 
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resources In your human services program. However, your most diffi- 
cult chore probably will be arriving at an accurate, reliable de- 
scription of what your program staff actually does, A study In North 
Dakota attempted this. Coonselors were asked first to estimate what 

r f 

percent of their time they spent In each of 13 activities (current 
status); then they were asked to rank the activities according to 
preference (desired program), A comparison between the two was made. 
The results are reported In the aforementioned Needs Assesaipefit Model 
for Guidance In Hortfi Pakot a (Lee^ 1973). The North Dakota tlm^ 
analysis chart 1^ one-way- to determine the allocation of sttfff time. 

have found that a dally log Is a good way to jrecord the ac" 
tlvltle&t and it can be filled In either by. a staff member or a 
trained observer* The log should be used for a one-* or two-month 



period over your program's* year. Ideallyi of course^ It should bi 

mot be maintained over 
long period. of tltae^ It should at least be filled Iri^ at scattered 



Intervals to'^nlmlze distortion.* 

The format of the log should not^ Ue so complicated that the 



\ 

\ 



staff member finds it a burden to use, Hcwever, the form should 
Include this Information: (l)"What happened? (2) Who was Involved? 
(3) How long did lit take? arid (4) Why was It done? The answers to 
thes^ questions cfan be brlef^ bixt each Item Is Important, lllie 
first three are <ibvd.ous parts of a log-,- 4H4t«4Jie~^uriJrlt^ailr4^tHe 
purpose^ or why i|t was done^^-may not be. The queBJ^;Lon tCies 
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the staff person's actl,vities to outcomes^ the goal toward which 
the activity is directed^ this is an esBeBtial part of the current 
status assessment* 

- Note this item froii a counselor log: 

Tuesday, March 14 

10:15 - 10:25 - Visit by new student 
This entry answers questions 2 and 3*^11^0 was involved and hew long 
it took — and gives a partial answer to question 1 — what happened, * 
It does not show* however, whether the student came in for assistance 
in eixroHing, information about the school^ aid in finding a part- 
time job* personal help in coping with a new situation^ a get-^ac-^ 
qi^ainted chat, or sotne other reason* It is important for the human 
services personnel to note the purpose of their actions. 

Displayed as Figures 2 and 3 on the two follcving'pages are - 
sample counselor logs- that were developed in concert with the coun- 
seling staff of Cherry J^jg^k High School in. Gierry Creek Colorado,. 
They are offered only as examples and could be modified* For 
example, if you have^ formulated specific desired outcomes,- t'he 
logs' sections on "'Why Did You^ Eto It?'' outcomes could be replaced 
with your outcomes. By recording your activities in terms of the 
desired outcomes, you should obtain key data for a cdn^arison of , 
the current and desired status J?f your program.' 
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In , addi tion to studying current documents, conducting time/ 
task/cost analyses, and collecting staff logs ^ you can add to your 
current status assessment by gaining information about the allo- 
cation of other resources* The current contributions of other staff 
menbers, clients ^ special personnel, and commimity members to your 
progran should also be measured^ as well as the current allocation 
of the nany technical resources* 
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£ xagiyl€ Act ivities and Prod ucts 
Involved ixx Establlebing Program Goals 

This set of activities brings together the results of philo- 
sophy and desired outcomes definition and current status assessment 
In a aet of goals that will serve as the cornerstone of your human 
services program* Program goals are the global statements of out- 
comes around which a program is structured* This set of activities 
also represents a juncture* On the one hand^ you look back over 
the planning activities to make sure they have been of hi^ quality* 
On the other, you look ahead to the more concrete definitions of 
behavioral objectives for your program consumers and program strat- 
egies to aid" thera in meeting those objectives* 
?ie activities in this set include: 

I* Defining discrepancies between the desired outcomes 
assessment results and the current status assessment 
results * 

2* Specifying the resulting needs statement iit order 
of their degree of importance* * 

3* Classifying goals into useful overall schemes for 
a program, 

4, Setting priorities among the goals* 

5* Evaluating the planning activities you have conducted. 
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Of the above activities, the third has been selected as the one to 
be discussed in more detail and to be illustrated. 
Classifying Goals, >J^ou^ay wish simply to map out an unstructured 
list of goals, but more likely you will want to classify and group 
them. Grouping goals will highlight interrelationships among them, 
encourage comprehensive coverage of all important areas, make it 
easier to conimunicate them to others, ai4 in evaluating results 
greying out of them, provide new perspectives to those who use them, 
and clarify their meaning* The first place to look for such a 

classification scheme is to your assessment instruments. If you 

J' 

collected data in well defined categories^ you can simply proceed 
to determine your program goals using the s^ne ^tegories , Not 
all assessment instruments lend themselves to such easy breakdowns, 
however, or the breakdowns used may not be appropriate for a sensi* 
ble grouping of goals* So if you need same classification scheme 
useful in mapping out your goals, the following are offered as 
suggestions that may be helpful* 

One model developed at AIR divides the concept of ^*career'^ into 
six areas and allows all goals (and subsequent objectives) to be 
classified into one of the six career areas. Therefore, career or 
life planning and development is seen as occurring in each of these 
six areas : 




Vocational Behaviors related to exploring' and making 
decisions concerhlag both opportunities. In the world 
of work and personal characteristics related to suchv 
opportunl ties-, 

Educational " Although often related to vocational be- 
haviors* behaviors In this area Involve exploring and 
pursuing educational opportunities Independent of^ or 
not Immediately having^ vocational concomitants. 

PersonaI"SoclaI " Intrapersonal competjencles needed to 
function effectively as an Independent person and In- 
terpersonal behaviors needed In small^group situations* 
Including twp*-person relationships. 

Academlc^Learnlng -i- Behaviors Involved In h'andllng dif- 
ficult situations and varied learning tasks more ef- 
fectively and efficiently In varied settings, not just 
In the formal classroom. 

Citizenship " Behaviors differentiated from those In the 
social behaviors area because^they are appropriate to 
larger groups of people and to secondary (e.g., govern- 
ment) rather than primary (e.g., family) social systems. 

Leisure — Behaviors utilized In the exploration of leisure 
cultural* and recreational pursuits; and behkv^ors In- 
volved In exploring one's personal characteristics re- 
' lated to such pursult3$ making decisions on thei^basls of 
such Information; and pursuing one*s Involvment. In avail 
able oppprtunltles , 



A second model, summarized In a monograph by the California 
Personnel and Guidance Association (1972)^ establishes three major 
categories of career guidance ,^ and additional subcategories within 
them. Each category represents a broad area of learning content 
necessary to help students develop work, life style, afid leisure 
satisfactions andachleve desirable societal outcomes • The basic 
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Vocational — Behaviors related to'exploring and making 
decisions concerning both opportunities in the world 
of work and personal characteristics related to such 
opportunities. 

Educational " AlcRcy^g^iQf ten related to vocational be^ 
haviors, behaviors -In this area involve exploring and 
pursuing educational opportunities independent of, or 
not immediately having^ vocational concomitants^ 

Personal-Social — Intrapersonal competencies needed to 
function effectively as an independent person and in- 
terpersonal behaviors needed in small group situations, 
including two-person relationships. 

AcademiCT-Learning Behaviors involved in handling dif- 
ficult situations and varied learning tasks more ef- 
fectively and efficiently in varied settings, not just 
in the formal classroom* / 

Citizenship — Behaviors differentiated from those in the 
social behaviors area because they are appropriate to 
larger groups of people and to secondary (e.g., govern- 
ment) rather than primary/ (e.g. , family) social systems. 

Leisure — Behaviors utili^d in the exploration of leisure 
cultural^ and recreational pursuits; and behaviors in- 
volved in exploring one*s personal characteristics re- 
lated to such pursuits; making decisions on the basis of 
such information; and pursuing one*s involvment in avail 
able opportunities . 



A second model, summarized in a monograph by the California 
Personnel and Guidance Association (1972) > establishes three major 
categories of career guidance, and additional subcategories within 
them. Each category represents a broad area of learning content 
necessary to help students develop work, life style^ and leisure 
satisfactions and achieve desirable societal outcomes. The basic 
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components and concepts identified in this monograph are as follows 



1.0 Career Planning and Decision Making 

1.1 Individuals differ in their interests, aptitudes, 
abilities, values and attitudes^ 

1.2 Ihe understanding^ acceptance and development of 
self is a lifelong process and is constantly 
changed and influenced by life experiences. 

1.3 Enviroment and individual potential interact to 
influence career development. 

l.A Individuals must be adaptable in a changing society. 
1.5 Career planning should be a privilege and respon- 
sibility of the individual. 

2.0 Education, Work and Leisure Alternatives 

2.1 Knowledge and skills in different subjects relate 
to performance in different work roles. 

2.2 Ihere is a wide variety of occupations which may 
be classified in several ways. 

2.3 Societal expectations influence the nature and 
structure of work. 

2 .A Ihere is a relationship between the commitment to 
education and work and the availability and util- 
ization of leisure time. 

2.5 Ihere are many training routes to job entry. 

3.0 Life Styles and Personal Satisfactions 

3.1 Work means different things to different people. 

3.2 Job satisfaction is dependent on harmonious rela- 
tionships between worker and work enviroment. 

3.3 Job specialization creates interdependency . 

A third and somewhat more traditionally oriented model classi- 
fies program goals partly according to the vehicle of ^elp. Ihis 
approach, adapted from several sources, identifies four major types 
of services a human services program may provide, and suggests pos- 
sible subcategories within the a^eas . Ihe deflection of the focus 
away from student outcomes and toward strategies of help is a 
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weakness of this model. 



Direct Help 
(Counseling with Clients) 



Individual Sessions On; 

A, Drug Abuse 

B, Vjeer Conflict 

C, Family Conflict < 
Pregnancy 

E, Self-Awareness 

Group Sessions On; 
^> Interpersonal 

Relationships 
Sex 



B, 

C, 
D, 
E, 



rugs 

Ly Problems 
:lslon Making 




III 

Post-High School Preparation 

1. Post-Secondary Education 

2. Occupational Information 

3. Educational Placement 
Job Placemenjt 

5, Test Information 



6. Decision Making 

— — 



7, L Values 



tl 

Indirect Help 
(Consulting with Parents 
and Teachers) 

1, In-service Sessions with Teachers 

2, In-service Sessions with Pai:ents 

3, Parent/Teacher Conferences 
4* Test Interpretation 

5* Occupational Information 

6, Educational Information 

7, Curriculum Revision 

IV 

Administration/Coordination 
1 , Orientation 
2 * Records 

3, Testing 

4, Evaluation 

5 , Registration 

6, Scheduling 

7, Placement (Educational and 

Vocational) 



Other models exist, many em useful and worthwhile. Your 

job Is to select or develop one tti^t best;,meets your own needs, and 

\ 
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structures your goals in the way that will be most useful, /} 

A part of classifying and grouping goals Is specifying for what 
target populations each goal is appropriate. Inasmuch as goals are 
general and broad^ they often will apply to an entire program's popu- 
lation, "To help clients to b^^ more skillful in making decisions 
and solving problems," is an illustration of this. It applies to 
virtually any client* But not all goals are applicable quite this 
generally; part of the task will probably become one of developing 
a set of goals appropriate for different age groups^ TTiese may be 
divided simply into elementary and secondary levels; into primary, 
elementary^ junior high, and high school; into youth^ adult, and 
elderly; or broken down in some other way more useful to your set- 
ting. But some consideration of ages and target populations is 
needed when developing goals • 

Example Acti vities and Products ^nvolved in 
Developit ig^ Cl ien t Perf ormance Objectives 

Goals resulting from the preceding set' of activities will be 
general and abstract* Objectives are narrt^wer in scope ^nd more 
specific!, Tliey are stated In a way that 1$ measurable and quanti- 
fiable; therefore, they help you to determine if you are reaching 
your broad goals, Each behavior should also have a specific target 
groups should include the conditions under which it will be measui^'d^ 
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and should have specific criteria defined for acceptable perform- 
ance. The result of putting these parts together is a complete 
objective , 

Activities that initiate the Developing Phase of this chap- 
ter's systematic planning^-^valuation model entail tasks such as the 
following: 

1. Deterfnining client outcomes* 

2. Writing client performance objectives that include outcome 
statements and thfee other ingredients, 

3. Using available banks objectives. ^ 

A, Sequencing objectives according to the developmental 
skills, of target t^opulations and domains of behavior. 
Since the first activity Is ^ fundamental to the others, we have decided 
to focus on it for further discussion and illustration* 
Determining Client O ut comes 

Writing objectives requires you to think of performances of 
your program's clients which indicate that a goal has been reached. 
O^te o|^the first problems you will encounter in going from goals 
to objectives is deciding what types of performances you wish to 
include, \ 

Many attempts have been made to classify human behavior -and 
educational objectives. Benjamin Bloom- (195&>^^d Krathwohl, Bloom, 
and Masla (196A) divide objectives into the '^cognitive domain'^ 

\ 



(knowledge), the "affective domain^* (attitudes arid feelltigs), and 

the 'psVchomotor domain^' (physical j=tklllq). FrpTiW w^^Hm^Ti' (XQ^7) 
uses three domains (educational^ vocational, and social and three 
functional levels' (perceptuallzatlon, conceptualization, and gener- 
alization) within each ' The California State Department of Educa- 
tion, In Its recent attenipts to set forth a model, has renamed these 
functional levels "awareness," "accowadatlon" (Internalization), 
and "action." Each of these suggests the progression from encounter- 
Ing and understanding, through internalizing and accepting, .c 
acting on the basis of the knowledge and attitudes* 

Presented on the next page as Figure 4 Is a graphic lllustra- 
tfon of the domains and levels defined In the California model* 
Figure 5 on the page following provides specific examples of the 
types of outcomes this model ^s proponents believe exemplify It, 
This model could serve as a useful framework for your outcomes (and 
subsequent activities) If you have not already developed a prefer- 
ence for another scheme. I^e material ^Is taken from the California 
Personnel and Guidance Association's Monograph 3, Accountability In 
Pupil Pers onn el Servi ces; A P^rocess^ Guide fo r the Development of 
Objectives , edited, by Howard Sullivan and Robert 0*Hare (1971). 

If you are already familiar with any of these^ classification 
schemes or find one kind of terminology easier to use than another^ 
act accordingly. But use some system* It will help in sorting ob- 
-jectlves and understanding the Interrelationships among them. 
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Figure 4 

Three- Dimensional Model 
for 

Pupil Personnel Objectives 



Educational 

Vocational 

Social 




FUNCTIONAL LEVELS 
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Figure 5 

Areas of Student Pevelopinent Within Each Domain* 



Educational Domain 



Functional lijevel 
Awareness : 

Accommodation; 



Action: 



Awareness ; 



Accommodation; 



Actloni 



Awareness of the educat;lona^ setting 
Awarenea3'^of personal characteristics relevant* 
to the educational setting 

Concept of self In the educational setting 
Planning of work toward achievement of edu- 
cational goals 

Coping wlth'thd demands of the educational 
environment 

Attainment of per^onal^ satisfaction from ed- 
ucational experiences 

Achievement of success In pursuit of educa- 
tional goals 

Vocational Domain 

Awareness of the world of work 
Awareness of personal characteristics^ rele- 
vant tp the vocational domain 

Concept of self In relation to the world of work 
Planning of wbrk toward achievement of occupa- 
tional goals . 

Implementation of vocational choices ^ 
Achievement of personal satisfaction from one*s 
vocation 

Achievement of success In the pursuit of vocar 
tlonal. goals / 



*Ado"p ted "from Wolimair {\^)biy ' 
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Social Donaln 

.Awareness ; Awareness of social responsibilities ^ oppor- 

tunlties^ and expectancies 
A^*areness of personal characteristics rele- 
vant to the so^cial setting, 

Accormiodatlon: Concept of self In a social setting 

Planning of efforts toward the achievement of 
satisfying and acceptable social relation^ 
snips 

Action: Coping wlch the demands of social groups 

vlth which one Is afflli^ed 

Attainment of personal satisfaction from 
social experiences 

AchleveTTient of success In the pursalt of 
social goals 
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Guldellrte« for Wrltlw Objectives 

Certain general guidelines can aid In developing b set of ob- 
jectives. A performance or outcome is a behavior that will indicate 
that the client has attained a goal* These outcomes aust be related 
to the goal. They must be significant, that is i something ycni 
really want to know about this clients They rrust describe what tht 
^cllent will be able to do, not what others vill do for the client, 
Cutcones should also describe the end result, not the procedures or 
activities the client will go through. They jiust be observable- or 
measurable. Therefore, you have to qse act-ion verbs ifl your Out- 
comes in order to avoid the pitfalls of vague, unmeasurable verbs 
such as Tcno^'ing/' "realizing,-' or ^'understanding/' These are dif- 
ficult to obsem/e and iteasure * The follcvlog are crther examples, 
of verbs that produce ambiguity and therefore should be avoided in 
your outcone statements; 

tQ^know 
to understand 
to really understand 
to appreciate 
to fully appreciate 
to grasp the significance x)f 
^ ^ to enjoy 
to believe 
to have fai th in 

Action verbs are subject to fewer Interpretations and are far 

more useful In describing what clients will be able to do* The 

following are action verbs that are useful irt generating client out- 

cooKs : ^ 
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discrlmloate 


' give evidence 


separate (^roup) 


identify 


apply (use) 


design 


recognize ^ 


make Inferences 


relate 


sort 


from 


cofipare how 


classify 


choose (from a 


contrast 


match 


list) 


Identify evidence 


'dlstlogul'sh 


Identify 


perform 


compute 


appropriate 


list 


calculate 


intsrpret 


draw 


explain 


operate 


.organize 


discuss 


define 


demonstrate 


state 


record 


predict (e*g, , 


construct 


describe 


reactions) 


make 


write 


name 



Note how thb action suggested by each of these verbs answers this 



question: What should a person be able to do to show that an ob- 
jective has been reached? Such **acts'' Involve a performance that 
demonstrates a skill, a knowledge^ a personal or social behavior, 
or^^an attitude * 

As you think of outcomes^ It Is Important to consider the 
developmental skills of the clients for whom the outcomes are 
appropriate* Behaviors that give evidence of attainment of a 
goal will vary vltb clients' learning experiences. If your pro* 
^gram has a goal that Is appropriate for all clients^ then you will 
have to think bf the outcomes appropriate for persons who have dif- 
ferent developmental skills, Ihese should not be determined 
strictly by age levels as Individuals at a given age or grade level 
will vary In ability, Ihey should build ^n one another, tracing 
a hierarchy from most bnslc Lo nos L .'Jdv.in**rd performnre. It, is 
at this point th^L <iubpopu 1 .(t f -^n*^ mist W latefullv co(i*= idered . 
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Individual needs and developmental skills vary a great deal, and 
objectives must be differentiated accordingly to be of real value, 
Ihink about wh sit each client subgroup can realistically be expected 
to achieve. Match expectations to the real world. Ihls is hard 
work, but essential for. a practical^ useful result* 

An obvious question at this point is how many outcomes you 
should generate for each goal?^ Ihe more precisely and completely 
the program goals can be spelled out in measurable objectives, the 
more likely it is that they will be successfully achieved. How- 
ever, if for each goal you were to write outcomes for clients at 
each level of developmental skills Tor each domain, you would soon 
have thousands of outcomes and consequently thousands of objectives. 
Ihls would be counterproductive to the purpose of writing perform^ 
ance objectives, which is to give seme clear direction to your 
program. No pat formula exists for defining the exact number of 
*ou*tcoitfes and objectives for each goal, but clearly you must set 
Some pi;lorltles among possible outcomes. We encourage you to think 
of as mihy outcomes as you can, remembering that not all goals have 
appropriate outcomes in all domains, or at more than one skill 
level. Ihen prioritire and select the outcomes around which you 
wish to develop complete objectives. To prioritize the outcomes, 
think of the criteria mentioned earlier; 
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Ootcomes mat be observable and unambiguous t^' 

2. . They atuat be relevant to the goal 

3. Ihey must describe what a client , not a 
staff member^ will be able to dOt 

4. They must be slgnlflcant—somfithlng that 
Ig "^rth being able to do. 



In selecting the outcomes around which you will build objectives, 
remember that the program should limit Itself to those outcomes that 
It can reasonably and successfully manage. Try to select those out^ 
comes that are appropriate to the program^ clients^ locale^ personnel^ 
and available resources. An Important part of outcome writing Is 
developing those that will best fit yo« particular situation. If 
"this means having to choose a few from among many possibilities^ the 
best course Is to pick a representative saaiple that fairly and ap- 
propriately covers the ground In question. In actual numbers^ a 
loose rule of thumb Is to have from f Ive ,to ten outcomes per goal. 
The best gauge Is the consitiered judgment of the people working In 
the situation In which the outcomes will be used« 

i 

Other Sets of ^^ tlyltlgg ln t^e; Planning^ -Evaluatlon Process 
tfe postulate that If you follow the segment, of four sets of 
activities outlined above> the planning^ development^ Implementation^ 
and evaluation of your program will be facilitated. However, we 
encourage you to become familiar with subsequent segnients of. this 
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process that flow from the results produced by the above activities. 

These additional sets of activities aVe briefly described below to 

illustrate the summaries presented at the beginning of this chapter. 

Selecting Altero ative Progr am Strgt^plea - 

Knowing exactly what you warit your program clients to be able 
f 

to do stll^ does not give you any plan for helping them actually ^ 
do it. This set of activities moves from statements of ends to con- 
sideration of means. Now that you have defined In precise, be- 
havioral terms the outcomes and objectives for your programi you 
need to think about how you can best help clients reach these ob-- 
jectives . Are the means you have used in the past the most effective 
Efficient? Practical? Have you consijdered the myriad of other 

/ 

possibilities? ^ 

Specifying Pro £e_6 ^5 Objec tiv e s ^ . 

Process objectives are analogous to client performance ob- 
jectives in the sense that they spell out in precise behavioral 
terms a more general definition. But they are different in two 
ways* Fl^rstj they apply to the program and what it must do rather 
than to the clients/ Second^ they spell out activities rather 
than terminal behaviors and therefore represent means rather than 
ends. When fully developed and organized, they form a plan of 
action that defines all the things your program must do to help its 
clients in the ways that you and they have decided are Important, 
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In addition, they define who la reaponalble for each taak and the 
date by which It ahould be accompllahed* In regard to assigning 
reaponslblllty^ they help you to match up ataff ekllla and Intereat 
with appropriate taake^ leading to what can well be a happier etaff 
and greater program efficiency. 
Developing Pro gram Sta ff 

In completing tha two procedlng aeta of actlvltlea^ you may 
have Identified aome areaa In which It would be helpful for your 
program'a ataff to have more fully developed or additional akllla. 
As ataff membera groi^j Into their joba^ they can continue to aeek 
education and develop talenta that can make their performance ever 
more valuable. In thla aet of actlvltlea you escplore how to go 
about locating and expanding auch ataff development potential ties . 
^ylnfi Out Actlvltle a Mog^ltocln^ Ey ly Ic y leroentatlQ Efforts 

Evaluation may be thought of In two. realms » fondatlvo/ and 
aummatlve. The latter deala with program accompllahmente and at^ 
talnment of goals at aomethlng approaching an ^nd pointy looking 
back over a aubatantlal period of time (aaj^ a year or more). Forma- 
tive evaluation refera to all the feedback mechanlema uaed as a 
program progreaaes that detect and predict problems and help planners 
make ongoing declslona to make -the program operate aa effectively 
aa poaalble* Exploring the wjqy^t to ,ibout conducting effective 
formative evaJuation li^ludes deciding when It is and la not Impor- 
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In addition^ they define who Is responsible for each task and the 
date by which It should be accompllshedi In regard to assigning 
responsibility^ they help you to laatch up staff skills and Interest 
with appropriate tssks^ leading to what can well be a happier staff 
and greater program efficiency* 
Developing Pro ^raa S taff 

In completing the two procedlng sets of activities, you may 
have Identified some areas In which It would be helpful for your 
program^s staf^ to have more fully developed or additional skills. 
As staff nkembers grov into their jobs, they can continue to seek 
education and develop talents that can make their performance ever 
more valuable. In this set of activities you explore how to %0y 
about locating and expanding such staff development potentialities. 
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Trying Out Activ ities an d Mooltor^lng Early_I^ lementstlOft Efforts 

J* 

Evaluation may be thought of in two realms, fomtktive and 
summatlve. The Istter deals with program accomplishments and at- 
tainment of goals at something approaching an /^d point, looking^ 
back over a substantial period of time (sa^a yesr or more). Forma* 
tlve evaluation refers to all the feedback mechanisms used as a 
program progresses that detect and predict problems and help planners 
make ongoing decisions to make tKe program operate as effectively 
as possible. Exploring the.vays to about conducting effective ^ 
formative evaiaation l^^^?^ude^; deciding wiien it is and is not impor- 
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tant to collect Information, how you go about doing It^ and how you 
make use of It when you get It, 

Conduct Sucima tlve Evaluation (Co^^iaMQt Studies) 

As the title* suggests, two key kinds of Information are sought 
In this type of program evaluation: the program's Impact or what 
It has achieved, and how much It costs. Whereas In formative eval*- 
uatlon the focus Is on the Individual parts of a program, here the 
Interest Is on the entire program* Decisions are still oriented 
toward how best to Improve the program; but hard choices about ellm- 
Inatlng parts of It may be dictated by the results, and-a longer 
range view Is required. This set of activities emphasizes how to 
design such evaluations and carry them out, and how to use the re- 
sults ^n making Important decisions. 
CommuTilcatlng Eval ua tion Re su lt s 

If you have carried out the preceding activities successfully-, 
you will have a well-^deslgned and evaluated program* But no one 
may know about It—a situation that la more than a cosmetic concern.' 
Other staff members, administrators, politicians, parents^ and 
clients all play a vital role In decisions about human services, pro- 
grams < Vou can make effective use of your evaluation report wlrth 
all of these groups. This set of activities entails three central 
concerns: decisions and the data they require, audience character- 
Istlcs, and resources available for producing the report* It not 
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only explores variations that can occur In the report content, for- 
mat^ and level of sophistication! hut also Investigates a varVety 
of techniques that will Improve any report, \ 

Summary 

V ■'^^ , 

This chapter briefly reviewed a fundamental segment of a \^ 
systematic^ p'lannlng'^evaluatlm model and process. Ihls segment \ 
entails conducting desired outcomes assessments^ performing current 
status assessments^ establishing program goals^ and developing 
client performance objectives. It Is our firm belief that this 
segment cavers a critically Important portion of the comprehensive 
model and process introduced at the beginning of the chapter. 

These activities ^are ones that invariably are| either ig^ciored 
by program planners and developers or are quickly glossed over. 
The results are human services programs with ill-defined goals and 
''objectives with an over-emphasis on delivering services for these 
ambiguous purposes^ and with an impossible design for any type of 
meaningful monitoring and evaluation. No wonder such a paucity of 
solid accountability evidence exists concerning the effectiveness 
and efficiency of many social action and educational programs. 

A major problem in ensuring that such a systematic program 
p lannlng*evaluatlon model and process is tried and tested is the 
lack of program staff skilled in its philosophy and techniques. 

03 
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There is need for comprehensive, well-planned approaches to in-* 
service education that focus on technical and professional 
skills necessary to implement such models* Such approaches should 
he structured in close coordination with preservice education of 
human services personnel who are then able to develop competen- 
cies useful in producing identifiable, agreed*-upon client outcomes. 
It is to respond to this problem \hat inservice staff develop- 
ment is currently being developed and field tested at AIR* At the 
same tiine^ plans are underway for articulating this educational 
effort with preservi^^ctivities* ' The aim of this staff develop-* 
ment is to provide the deliverers of human services with skills 
necessary to effectively plan, develop, implement^ and ev^uate 
social actibn or educational programs* This approach is discussed 
further in Chapter III, 
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Building on the systematic plannlng^valuatlon model aAd process 
summarlied In Chapter 11^ this chapter addresses the Issue of 
helping human seinrlces parsonnel learn the knawledga and skills 
they need In order to employ that approach. Philosophical as- 
sumptions basic to the type of staff development recommended 
here are briefly reviewed. Fundamental competencies on which 
this staff development focuses are listed- The nature (l.e.^ 
objectives, format, activities^ and expected outcomies) of the 
learning process Is summarized ani Illustrated, Finally, gene- 
ral conclusions from recent pilot tests of this educational 
approach are stated, as are problems that accompany its Imple-* 
mentation. 



Chapter III 

Developing Staff Skills for this 
Planning'-Evaluatlon Model and Process' 



A ssumpti ons Basic to this Staff Develop^mr Approach 
Through the pilot and field tests of this and other staff devel- 
opment activities, we have painfully learned the Importance of both; 
making explicit the assimptlons on which our design and Implementation 
activities have beeri\founded and stating these at the beginning of 
any presentation. In this .way we do not take these assumptions for 
granted and our audience has an oppbrtunity to review and challenge 
them, if they sfo desire. Such ls_ the purpose of this section. 
Assumptio n I: The deliv ery of human servlces^ee^ds t o be i mproved , ^ 

More specifically^ we believe there is a need for more compre- 
hensive systems of guidance^ counseling, placement, and follow-through 
in a number of settings (e.g.^ schools, colleges > ctwranunity service 

bo 
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(penterSj Correctional rehabilitation Institutions, employment ser- 

i ! 

vices), for school settings this ne^d was well documented by^ an 
AIR study ; completed during the 1972-^73 fiscal year'for the Unltefl 
States Office of Education's Office of Planning^ Budgeting^ and 
Evaluation (USOE Contract 3fOEC"0r.72"4986) . After surveying the 
Ration to f ind^ e f f ectlve guidance > counseling, placement^ and follow 

i 

up programs for non-^college-^bound youthj and producing an e^^^tenslv^e 
literature preview (over 150 pages)^a final report, ^nd 13 case 
studies, we concluded that programs h^ not yet been' realized to 
meet the needs of su^ youth. Further, .speculated on the dlrec^ , 
tlon that should be taken by future attempt^ at Improving such 
services ; 

If 'guidiance systems are to be realigned , to Timet^ genuln^ needs 
of yout|i as conceived by the authors ^ there ls\a maj^r;need for 
rigorpus program development. The potential to\cg*ndj^ct such 
develjt)pment and evaluation requires explicit, clearly defined, 
and Titeasurable program objectives and an accurate Ntnowledge of. 
J the practical arid political ifcyhtext In which judgment^ jconcern- 
/ Ing achievement of these objecN:lves must be' made * Tnfen fiata 
generated by a pro^gram must be: correlated with these\objec- 
tlves , as specifically related to the behavior of membe\s 6f 
the target population; collected accurately; presented In. an 
'easily interpretable form; and provided in time to be useckby 
dedislon-makers at all levels with a means to evaluate cosri 
benefits and cos tref fectlveness . (Ganschow^ et al'», 1973, 
p. 5-25.) 

Thei i/igorous program Improvement called for In the above statement 

^ ,' 

Implies the need for a systematic planning-^evaluatlon process such 

■' i' ^ ■ ' 

as|/the onef outlined In Chapter 11, ' \ 

^ ' • ■ / 
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Assumption 2f Thoge . hua yn ^ ser vices that focus on influ encing th e 
career de v elo pme nt of ^thel^r^clieate fthou ld fo cus on a b road defini- 
tion of^ ''career /'_one that ic more syno^njnnous'wUh ''li^fe^.^ 

Rather than define career simply as vocation, we view It more w 
broadly as a life-development process which Involves all the Impor- 
tant elements in^an indlvldua'l's growth toward what s/he would like 
to be; Ihe six elements that we Include within this broad concept 
of career are listed and defined on page. 44 of . Chapter 11,, In this 
context, career development entails many aspects life besides 
those related to school and work declsion'^maklng, , . ^ 

Assum ption 3 : Many persons engajged_ln the^ **?_i^^}^?^y_Pf, human serviced 
prese ntly l^k_tjjejiJLannitig and^ evaluation competencie s he ed ed for ^ 
effecti ve pr o-am improvement^ and should ^ r ' ^e comp e tie nty^b a& ad ./ 
staff development assistance^ Staff development' attemptlngto de- ^ 

' r , ■ • 

JLiver the required coB^etencies Is th^rejqfe nee ded . ^ 
- ' We use the terms ^'cDmpetengles'^ and "skills'* Interch'^jgeably,, ^ 
The» starff development approach on which we have been working attempts 
to go well beyond the cognitive and attitudlnal levels emphasize 
In many conventional Instructional ,prog,ramfi, for human services per- 
sonnel< We concentrate on the actual sk£lH and behaviors such perr 
sonnel i^equire in'^order to develop and deliver comprehensive ^e^lces. 
Such' skills have to be operationallzed'by observable performanc^, 
preferably ones that can be evaluated by the successful prodggtiori 



ERIC 



of a product having measurable relevance for practical settings, 
Aijs uri p tion A : Insuf ficient infonnatio-T has been available^/ oif 
gene rating the tyj pe of^ competency-based staff developme nt suggest ed 
above . 

Until recently no concentrated e f forts had been made , to imple- 
ment activities outlined in the following process; 

1, Identify gepfrtiu: and situations-specific taaks that h^an 
service^personnel perform in practical settings (i,e.» 
conduct a task analysis). 

V 

2, Specify competencies (initially stated as desired outcomes 
for such personnel) needed to perform these tasks ■ (i ,e ^ 
conduct a competency amalysis), 

* 3'.' Select and design assessment strategies by which such 

competencies can bs measured. What performance-based 

assessment techniques exiet^ what techniques are presently 
f * 

1. 1 

under development, and how cam they best adapted? 
Such techniques must assess the skills each participant 
has J the one s/he needs to develop, and those s/he wants 
to acquire and practice (i.e,^ competency assesstnent) • 
' 4j Design and evaluate^ performance^based instruct^^ofel se- 
quences (including matt^rials and strategies) that pro- 
vide learning experiences appropriate to the competencies 
selected • ' ^ 
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5, Determine how-to evaluate the ef fec{;iv|nes& of the staff 
deve lopment • 

6, Pilot test, revise, and field test^ the staff development. 
Then, revise it again before integrating it into regular 
pre- and in-service training sessions, 

7, Validate the competencies produced by using experimental 
and quasi^experimental designs appropriate for determining 
the relationship between human services competencies ac^ 
quired and client improvements made* 

S, Conduct data analyses to determine what staff development 
techniques are most suitable • What kinds of problems com^ 
mdnly arise, and how might they be avoided or corrected? 

9. Conduct evaluations by selecting appropriate criteria for 
assessing the success of the staff development series. 
Provide for the formative evaluation of the staff develops 
ment used* 

These are the areas' to which we have been devotit^g our Research and 
development energies over the last three years. 
Assumpti on 5j__^ T^er^ is ja geroral ^n«cd for ctore Innov ative and 
s ystem a,tic educ atioDal procedure tor^ develoj^ing h^gaan^ ser vi c es staj f 

For example, in the area of counselor development ,^ several 
studies have suggested that couns£lor'-«f fectiveness may bear little 
relationship to traditional counselor education programs , both pre- 
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service and in-service (Joslin, 1965; Engelkes and Roberts, 1970). 
In /act^ some counselors and counselor educators claim that the re- 
lationship is more negative than positive (Carkhuff, 1968; Island^ 
1972). 

Cash (1972) challenged counselor educators t& review their edu^ 
cational Processes and to revise them^ if rtecessary^ to focus on 
prograj^ output. Counselor educators have been encouraged to specify 
in operational tenns their instructional objectives and performance 
criteria, ^'Without specifically formulated behavioral goals, the 
accountability of a counseling curriculum Is highly suspect (Horan, 
1972, V. 1^3)/' 

N'ew ways of learning and teaching are urgently needed in pre^ 
and in-servtce counselor^education; this is our fifth assumption. 
Counselor educators have been criticized for not rnaking greater use 
of innovative programs and designs from new educational technology 
such as instructional objectives and modular packaging (Koran, 1972; 
Bramnier and Springer^ 1971), While the professional literature in 
education and. in guidance has been highly supportive of the devel- 
opment of learning objectives and implementation of cofnpetency-based 
programs > few operating programs are In existence* Of those counsel- 
or education programs that have developed a comprehensive series of 
learning objectives^ few have used modular packaging as a delivery 
system for educating counselors to use this type of information. 
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We coumitted ourselves to developing a staff development approach 
that is relevant to all human services personnel, not just counselors, 
and is; (1) systematically planned and organized, (2) individual- 
ized and personalized to learners* needs and characteristics, (3) 
objectives-based, (A) built around coordinated instructional modules/ 
kits, and (5) sequentially organized on a continuum of increasing 
complexity of learning outccrmes, 

Asairnption 6; There should be artlculatlop of transp ortable staff 
development across pre*- and in*service settings* 

The discontinuities between pre- and in-^service learning ex-* * 
periences have become more apparent in recent years. Competency- 
based learning can remove some of these discontinuities if it is 
tailored to skills that practitioners require in order to perform 
their job tasks better* As noted above, conventional staff develop^ 
ment has not concentrated on the specification of job activities ^ 
competencies requisite to them, and instructional procedures design- 
ed to promote such skills. If these information needs are resolved^ 
pre- and in-service learning experiences can be coordinated by ,an 
agreed-upon set of competencies, expressed as measurable objectives* 
To maintain its usefulness, such staff development must not only 
be applicable to pre- and In service settings, it must also be 
structured so, it can be administered in places other than where 
it was developed and by persons other than the developers* Per-haps 

V 

68 



T 

at leafit 751 of each learning component should be transportable • 
As s ump t i on 7 : Ih eje__jmjs be^ both^^individual .and instituti onal c om" 
mltment_lf hum an eervlceg are going to be icy rov ed . 

In many ways, this final assumption emphasizes factors that 
are well beyond the control of a staff development approach. How- 
ever, homan services personnel should Ifearn to recognize the impor- 
tance 'of these factors and have at least some preliminary skills * 
for dealing with them, Ihese factors Involve system or Institutional 
constraints that inhibic program improvement. Institutional open- 
ness to change aod willingness to allocate resources that will fa- 
cilitate program modifications are difficult to ensure. When it 
comes to challenging entrenched authority or ingrained behavior, 
many reforms go a-gliamifiring . Ihe influence of such attitudes* can- 
not be ignored; these factors must be identified and, if possible, 
dealt with as early as possible in the program improvement cycle • 

'Focus of this Staff Development Appro_a_ch 
, As stated in the preceding section and in Chapter IX, the staff 
development approach that we have been developing and researching 
focuses on the competencies human services personnel exercise in or- 
der to plan, develop, implement, and evaluate their programs. 
Figure 6 on pages 71 through 7 7 presents a condensed version of the 
knowledge outcomes and sklH^ tJi^^we initially Identified as 
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particularly conducive to implementing dll segments of the systematic 
program pldiming"«vdludtion model dnd process described in^|^apter II. 
Notice that within the Implementing Phase^ general counseling skills 
/needed for individual and group counseling a^::^included. 

Hiat domain of competencies is followed by Figure 7, which dla- 
gf ammatically summarizes the preliminary set of modules that we have 
selected to provide staff development in high priority skill areas 
of the; planninj{"*€valuation model. There are 12 modules, the length 
of each averaging about six hours, or the equivalent of a one-day 
workshop. Thus, this approach can take anywhere from one to two-and- 
a-half weeks. A coordinator is required to lead discussions, pro- 
vide feedback on activities, and evaluate participants* responses 
to test items* A written guide is provided tb help coordinators 
implement these tasks, kore specific details on the nature of all 
parts of these module packages is provided in the next section. 
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Figure 6 
Domain of Competencies 



Orientat jojt of a j3on^reheoeive ^proach to Program^ Improvement 



Explain to another person the comprehensive approach to 
program improvemwit, - *^ 

Explain the advantages of the comprehensive approach. 

Explain how competency'-based learning in this series is 
related to uding the approach. 

Indicate what competency--based learning, if any, is relevant 
to self . 



Phase Planning Programs 

Defining Ph ilosophy, Purposes^ and Target Groups 

Define the philosophy and purposes and designate the general 
target populatlon(s) of each program being planned. 

Assess the current philosophy related to human services, and 
the current planning approach used; and, if necessary^ work to 
develop an environment conducive to the implementation of the 
comprehensive approach • 

Develop an approved, written statement of the philosophy and 
purposes for which each program will be designed. 

Develop an approved, written description of each program's 
target population(s) . 

Assessing Cur rent Context and Programs 



^sign, conduct, and report an assessment of the current 
context in which each program will operate, 



/ 



Develop an approved^ written sunmkary of all assessment data 
collected on the general characteristics of the context in 
which each program will operate and the current status of 
leamer'^re lated outcomes related to both system needs and 
society needs. 

Davelpp an approved^ written summary of all assessment data 
collected on human services currently available in the 
target area. Such data should include statements of current 
services provided^ outcomes those services try to help 
program reci'pients achieve^ and the number q^persons served. 

Assessing Desired Outcomes ■ 

r-i-^p 1 ■ t ■ ^ * . 1 1 — ; ■ I ■ ■ 

Design^ conduct, and report at^^ assessment of desired dutcomes 
for program consumers in the target ^r^a. 

Identifyi ng Meeds Iftltijn^ Goal^Statemen^ts^ a nd Outcomes; 
Communicating^^d EvaTuating' ftanninfi Decisrons and Activities 

Integrate data on current and desired programs in order to 
develop an approved^ written statement oh high and low- 
ranking needs and wants of program recipients in the tar'gBt area 
based on learner needs^ and school system ^d society needs 
derived from empirical data. 

Produce an approved written summary of sequenced goal^ state- 
ments and student performance outcomes for^ each proposed human 
services program. 

Identify all audiences that should ^ receive communications at 
various states of program improvement, their communication 
needs^ media appropriate to their . characteristics and needs^ 
and a dissemination schedule. 

Evaluate and report (in appropriate dissemination 
documents selected abov^) the effectiveness^ efficiency^ and 
desirability of decisions ^d activities conducted during 
this ^phase of program design. 

Phase II; Developing Pr ogram s 

Specifyin g Inmiediate Pro^gram Participants an d Objectives 

Select each program's participamts and specify program objec- 
tives related to the current status of each participant's skills 
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Develop an approved, written summary of all assessment data 
collected on the general characteristics of the context In 
which each program will operate and the current status of 
learner-related outcomes related to both system needs and 
s^lety needs , * 

/Develop an approved, written sunmiary of all assessment data 
collected on human services currently available In the 
target area* Such data should Include statements of current 
services provided, outcomes those services try to help 
program recipients achieve, and the number of persons served* 

Assessing De sired Out comes 

Design^ .conduct, and report an assessment of desired outcomes 
for program consumers In the target area* 



Identifying ^ Jeeds; Wr^t Injj^ Goal^St axemen ts^ a nd Outcomes; 
Communicating"' and EvaJ^uatln^ P^lannlnjg Decl^slons and Activities 

Integrate data on current and desired programs In order to 
develop an approved, written statement on high and low- 
ranking needs and wants of program recipients In the target area 
based on learner needs, and school system and society needs 
derived from empirical data* 

Prod^ice an approved written summary of sequenced goal state- 
ment's and student performance outcomes fo^ each proposed human 
services program. 

Identify all audiences that should ^ receive communications at 
various states of program Improvement, their communication 
needs, media appropriate to their characteristics and needs, 
and a dissemination schedule* 

Evaluate and report (In the appropriate dissemination 
documents selected above) the effectiveness^ efficiency, and 
desirability of decisions and activities conducted during 
this phase of program design* 

Phase 11 Developing P rograms 
Specifyin g Jjmmedlate Progr^ P artic ipants an d Objectives 



Select each progt'am^s participants and specify program objec- 
tives related to the current status of each participant's skills 



Produce an approved, written description of the general 
characteristics of persons from each program*s target 
populatlon(s) who will receive that programi 

Develop an approved, written set of objectives (including 
specification of the target persons^ directly or Indirectly 
measurable desired outcomesj conditions for testing, training, 
and/or real-life performance { and etandarde of performance) 
for each proposed program planned for Immediate Implementation, 
(Program objectives probably will reflect different develop- 
mental orientations at the various learning ability levels of 
program, participants but should be smoothly articulated across 
these levels * } 

Design, conduct, and report criterion-referenced assessment 
of the current status of each program participant's skills 
to determine her/his placement In the program. 

Investigating . Selecting, and Develop-lnjj Pro fjram Procedures 

Identify alternative procedures for helping learners achieve 
appropriate objectives, and select and develop procedures for 
each program. 

List all available and possible strategies and procedures 
that can be used to help participants achieve objectives 
which are relevant to their needs In each proposed program. 

Produce an approved, i^rltten description of selected pro- 
cedures for helpingi^partlclpants achieve each proposed 
program^s objectives, 

Connminl eating £yaluatlrig^Pr^c^r^ Stnictu rlng Decisions / 
and Actlvlt;les 

Disseminate appropriate communications summarizing products, 
progress, and problems resulting from the decisions and 
activities of this phase of program development. 

Produce for each/ communication audience dissemination 
products summarizing each program's desired outcblhes;^ 
objectives, participants^ resources^ and procedures In 
order to elicit ideas and support for subsequent field tests. 

Evaluate and report (in the above dissemination media) the ef- 
fectiveness, efficiency, and desirability of decisions and ac- 
tivities conduc^ed^^duj^ing this phase of program development. 
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Phaee XXI^ Iii^pIeiQfotlQg Programs 



Stating Pr ocedural W>^ectlyee and iTpplet nenratlon Strategies 

State procedural objectives and Implementation strategies 
for each program and obtain clearance for the field test 
evaluation^ schedule^ and costs » 

Develop an approved^ written description of the tasks which 
must be perfonned to Implement smoothly and effectively the 
proposed field test(s) of each human services program. The 
description should list: (l) general tasks ( vrltteo as pro- 
cess objectives ) that program Implementers should accomplish 
to ensure that participants In the field test sites have o 
portunltles to meet their performance objectives; (2) more 
detailed tasks briefly outlined as Implementation strategies ; 
and (3) learner process objectives that describe activities 
participants will perform to achieve performance objectives 
In their Programs of Studies, 

Deslgn> pilot test, and revise a support system (computer- 
free^, computer^asslsted^ or computer-monitored) to handle 
data on participants^ characteristics and performance. 

Produce an approved^ written description of field test costs 
aira a rational? that describes the evaluation design^ proce- 
dures^ and schedule^ and lists Instrument specifications for 
assessing the extent to which participants In the field test 
sVte(s) achieve their goals and objectives. 

Sele&Hng Program Staff and Initiating Staff Development 
Activities 

Identify, recruit, develop, monitor, and evaluate professlcmal 
and parapr'df esslonal personnel who can Implement the proposed 
field test(s). 

Design and conduct analyses of the tasks that must be per- 
formed to Implement successfully each program In the field 
test slte(s)» and analyses of the competencies needed to 
perform these tasks- 

Identify those tasks that can be performed by humans and those 
that machines can best provide, and then design and Implement 
procedures for assessing the qualifications of available human 
and machine resources • - 
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Select hwan and ntachlne altematlvee capable of supplying the 
needed competencies and Identify options that need further de-* 
-*^eIopflient In order to attain satisfactory task performance> 

Develop and test the desired machine resources as well as col- 
lect^ cr^ate^ and pilot test competency-^baeed ^taf f development 
packages and train those personnel who do not have the compe<- 
tencies they will need. Training could be provided In m'any com-* 
petency areas. For example, staff members should! 

Relate effectively (language, rapport, respect, fair- 
ness , support) to learners, parents^ and other program 
personnel* | 

Utilize: (l) existing Instructional! packages or 
units; (2) tests; (3) various counseling approaches 
(e.g., clleivt centered, existential, Gestalt, psycho- 
analytic, ratlonali^emotlve, transactional analysis, 
and parent-^teacher effectiveness); (4) specific 
strategies (e.g., use a problem-solving process to 
help clients meet their tteeds ; help clients acquire 
and apply decision skills; demonstrate personal- 
social contracting techniques; engage clients in 
role playing and behavioral rehearsal activities; 
assist cllents'ln self-assessment processes; help 
clients acquire and apply behavior observation and 
analysis prqcedures; help clients learn and practice 
self confrontation; tra^ clients in relaxation and 
desensltlzatlon techniques; employ rewards, punish- 
ment, and extinction principles with clients- and 
self; and assist clients to acquire and use self- 
- , management and self control skills); and (5) explore 
various techniques for group counseling and guidance. 

Analyzfi key factors of the Institution (learning 
envlroment, relationship to the community, resources, 
requirements, strengths, and weaknesses) and their 
re^Iatlonships to human services programs/ 

Be sensitive to contemporary problems (drug^ racial, 
sexual) and traditional problems (family, academic, 
- social skills). 

Design and implement a staff and machine monitorln?^. 
evaluation, and renewal process to ensure that Imple-- 
mentation tasks are perfbrmed effectively. 
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Preparing, Field Test Sites 

t 

Prepare the field test slte(s) and conduct and report process 
evaluations of Implementation activities, 

Prepare slte(s) that are equipped vlth the materials and 
resources needed to Implement each program in the field test^^s). 

Implement each field test^ program as described In Its process 
objectives and analyze limited, lf*any, negative side effects. 

Conducting* Communicating^ and Applying Reeults from Process 
Evaluations 

Design and conduct ongoing process evaluations of the effective- 
ne63» efficiency^ and desirability of program implementation 
decisions and activities; report the results of these evaluations^ 
to appropriate audiences; and make decisions related to subse-^ 
quent program implementation based upon them^ 



Phase IV: Making Decisions Based 
otx Program Costs and Impact 

Conducting and Reporting Summatlve Evaluations . 

Design^ conduct, and report product evaluations to^assess the 
Impact of each human services program implemented in the field 
slte(s) . 

Determine if participants have satisfied their needs af tejr 
they have participated in the field test program.Cs), 

Determine if the satisfaction of participants' needs can |be 
attrlboted to the affects of the field test program(s) . I 

Determine any unanticipated effvri^ '(ppsitive and nej^ti\fe) of 
.the fit*Id test pro^^ramf ) (jii ji^ir t p;uit s ^ staff* parents* and 
rli'^ ! J (O^* I , I ■.- r 1 I uy. , , I 

I 

Mm < I n ( 'i4 f ii I Ml i -ii ; : |ii I ■■ ' [M oj^^ inf ' ' , I I M 
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Conducting and Reparting Co« t^rEf Elclency Evaluations 

Design J conduct, and report quasi-'experlitiental or true experi^ 
mental studies that identify the most cost^eEficlent procedures 
and programs for helping learuers achieve their career planning 
and development objectives* 

Conducting and Reporting Cos t^Beneflt Evaluations 

Design Aconduct and report cost-benefit studies to assess the 
impact of field test prograia(s) in the light of long^^range 

ne ^dlsoclal considerations as we'll as changing human ^ sys- 
teiow and/societal needs. 



SSSnunlcating Costs and Imp act Pat a 



Hake;' decisions related to necessary future human services and 
^han^es in field-^tested programs, and communicate these decisions 
/and Jtheir rationale to appropriate audiences. , ■ 
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Nature of 'tiiin St^f Development Approach 
.Ihe- topics of our initial 12 staff development modules are 
listed in Figure 7. Central to these topics are th« statements' 
of each module's* behavioral outcomes^ jus*t as statements^ describing 
desirable client outcomes are central to the human services pro- 
gram. ' . - ' 

Expected Staff Development Outcomes , ft— ' . " . 

* " ' iL 

. ■ i-^ ' 

The outconies that partlcipdivf s are expected to achieve through ^ 
this staff development dp^Jroach are summarized below by module* " * 



Module 1 - Career Development Ih^ibry^ Particlp^t expected 



outcomes include the abilities to; , 

1,. Identify current practices in your career guidance 
' prtfgram that reflect each of the eight -careei^ ozf 
r vocational development theories. ^ ^ ' 

2. For each theory, list at* least one additional activity 
you would consider adding to yoUr program, 

^ 3. State the assumptions upon which your current 
guidance program is 1>ased. 

4. PBoduce a written plan which^ when implemented^ will 
result in a statement of the philosophy and assump- 
tions underlying the career gui'dance^ program you will 
develop through the course of these modules,' * 



Module 2 "Program Development Model, Participant expected ^ 
outcomes include the abilities to; 
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1. List at least three common guidance problems to wMcn 
the approach described here can help provide solutions'. 

2. Describe the essential characteristics of tfie career 
■guidance program iiproverient approach discussed in the 
nodule^ and list several of its advantages Snd disad- 
vantages * 

4 ■ 

3. List tne essential skills to be developed irt this 
s taf f deve lopnent prog ran . 

4. Identify the Setiils you want to develop in the staff 
development prof.rasj. 



Module 3 - A-ssessing -Desired Outcomes, Particip^t e5q)ected 

put CQ:=es incite the abili ties to ; ' ' 

1. Understand and state the value of assessing the 
desired outcomes of a progranii 

2^ Specify the tasks and considerations in assessing 
'a p.rogram's desired outcomes. 

3. Perform basic skills involved in assessing a pror 
gran's desired outcornes^ including: 

a. Defining the populationfs) and selecting 
^ . Vhe jample(s).^ 

X^^^^^^-^-T-^Selecting/developirig assessment instrunents 
c . Adminis tering instruments . 
d. Summarizing and trans lating ' data into 
, . desired outcomes* 

I 

4. Develop a plan for defining the'^i^ired outcomes of 
your program. 



Module 4 - Assess ing -Current Status. f*articlpant expected out- 



conjes Jnclud*? the abilities to: 



1* Define '*current status assessment/' state its empha- 
sis^ and explain how it fits into the needs assessment 
process * 

2. State the huraant financial, and technical resources 
of a guidance program* 

3. Adapt and/or use an Instrument for detenrdning how 
^ resources are being used currently* 

4. State what techniques are available fpr il^^sesslng 
current status, 

5* Review and select Instruments » and items froiannstru^ 
ments, for assessing the current status of stui 
according to appropriate criteria* 

6. Produce a plan for assessing the current status of 
your program* 



r 

Module 5 - Establishing Needs and Program Goals* Participant 

'expected outcomes include the abilf^ties to: 

1. Define the phrase '*program goal" and give an exainple 
of one , 

2* Identify program needs by comparing desir^ outcome 
and current status information to determine the 
dlscrepen cies . 

3. Draft goals for a prograrr^ based on the program needs 
and other relevant inf orriation » 

4, Ciassif/ goal.s into a liScful oviL^rall scheme* 

5 . \>e t L-rmine pr i ^ i i t i f >r :h(* ■ ts ■ a program. 

u , iw^fin^^ i.-'i^ ^ ^^^'J T . [-^pHrra^it in evaluating 

\ r> r w ny ^ - ' .i< ' ] " i it*ii ? . I v^'^> m> p lanning 



7* Produce & plan for developing program goals fbr 
your program. 



Module 6 - Specifying Learner Performance Objectives* Parti- 
cipant ,e3tpecte<;J oatcomes include the ab ilities to ; 

1. State the reasons for and, importance of vrlting 
career guidance student perfonaance objectives* 

2* Vfrite an outcome stating an identifiable performance 
for a goal statecent* 

3* Write^ or select and modify, a full objective for 
an outcome. Each such objective will contain the 
four components of a good objective* 

4* Produce a sequenced list of all objectives pertaining 
to a given goal statetnent and target population* 

5* Produce a plan for developing student performance " 
objectives for your program, ' 



Module 7 - Selecting Alternative Program Strategies* Parti- 
cipant expected outcomes include the abilities to: 

1, Write a definition and give three examples of 
guidance s trategles « 

2, Write a Set of your criteria for considering alter- 
native strategies for guidance objectives, 

3x State your decision rule f or^selecting a strategy 
to use to reach a guidance objective. 

/a. Produce 'a pl^ for selecting program strategies 
/ at your school. 



82 



ERIC 



Module 8 - Specifying Proces^ Object ives . "Paxticipant ex- 
pected outcomes include the abl iities \o\ 

^1. List the advantages of writing process objectives. 

2, List process objectives that must be perforroed Iq 

" - - — wier -to ^fla plcaon^ ^-g^-Wft-^-tgAtogy^ ^.^^^ 

3, Assign staff members to carry out process objectives 
by matching available staff skills with needed 
skills tiv acccFmpHsh the objectives, 

4, Schedule process objectives by use of PERT and by 
use of time,^ask, and talent analyses, 

■ 5, Incorporate prVess objectives into planning ac^ivi- 
ties at your school or district* ^ , 



Module 9 - Developing Program Staff* Participant expected 
outcomes include the abilities to; 

1, ' "^ae the Skills Checklists to write staff develop-- 
Tm^t objectives, 

2* Create your own staff development strategies by 
combining available sources of help with possible 
delivery laethods, 

3, Use the criteria suggested in this niodule and/or 
your 'own criteria to select staff development 
strategies suited to your school or district, 

4, Outline the planning and implementation tasks that 
would need to be completed in your school or dis- 
trict to carry out a given strategy, 

5, Map out a plan for developing and administering 
your own staff development program. 
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Module 10 ^ Trying Out Strategies and Activities, Participant 
expected outcomes include the abilities to; 

1, State the primary purpose of carrying out preliminary 
activity tryouts and describe at least two ^Ituati^ons 
in which such pilot testing is useful, and two in 
which it is a waste of %im&^ 

2. Verify the internal logic of a planned career guid- 
ance activity, given a written description of such 
an activity covering its goals, student performance 
objectives^ and process objectives, 

3* Develop a relatively accurate estimate of the cost 
of' impl&gtenting a career guidance activity, 

4, Develop measures of attaintuent of the process objec- 
tives of a career guidance ac^vity, given a written 
description of the activity and its process objectives 

5, Develop relatively objective, reliable* and valid 
measures of the outcomes of a career guidance activil 

6, Develop a plan for trying out activities and mohlt^r- 
Ing early implementation efforts at your school 



Module 11 - Conducting Summatlve Evaluation, Participant 

expected outcomes include the abilities to: ^ 

1, State the'purpose and value of conducting a 
summatlve evaluation, 

♦ 2, Select an appropriate evaluation design and sample, 
given an evaluation situation, 

3, Select, adapt, or adopt appropriate measurement In- 
strumentSt given particular evaluation oeeds, 

4, List the tuajor considerations involved in admini- 
stering evaluation instruments. 
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5, Propose appropriate methods for processings analyzing^ 
and presenting evaluation data* 

6* Identify important considerations in determining 
cost effectiveness, 

7, State appropriate decisions based on evaluation re- 
aultSj given an evaluation situation, 

8, Map out a plan for conducting a summative evaluation 
of your prograCTN. 



Module 12 - CotnniunicatingN^aU^*^^ Results, Participant 

expected outcotnes include the abilittft^to: 

1* Explain bow content, format^ and level of sophis- 
tication can vary in an evaluation report^ 

2, Choose content, format, and level 6f sophistication 
appropriate for: (a) decisions and the data they 
require » (b) audience characteristics ^ and (c) re- 
sources available for producing the evaluation re- 
port * 

3* Specify how to use simple, logical organization iti 
preparing evaluation reports, 

4* Specify how to use concise language in evaluation 
reports, 

5* Specify how to use clear, accurate presentation of 

data in evaluation reports^ 

6, Specify appropriate methods that contribute to an 
interesting » attractive presentation , 

7. Tailor your writing and presentation of data to be 
appropriate for (a) the decisions and data needed 

. ^ for them^ (b) audience characteristics » and Cc) re^ 

sources available . 
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8, .Identify the reporting considerations for your ovn 
situation and develop a plan for reporting evalua- 
tion results using communication strategies appro-- 
prlate to the considerations you have identified^ 



Module Objectives and their Puryoees 

Each module has a set of objectives that incorporate the parti- 
cipant outcomes listed above and serve at least three purposes. First, 
they direct the module design and writing activities. The module 
developers do not begin their detailed work on content until Its ob- 
jectives have been agreed upon and stated in the caost measurable form 
possible at that point in the development sequence. Like anv behavlnr- 
al objective, each sta^Dment in the set must have four parts; (1) an 
indication of who should be able to perform the objective (that ig 
easy In this case » since It will be the staff persons experiencing 
the module); (2) the outcome those persons will be able to perforr^ 
If they achieve the objective (two types of outcomes, knowledge and 
skills, are listed in the preceding section); (3) the conditions 
within which such outcomes will occur; and (4) the standard(s) that 
will be used to judge the adequacy of the performance. With blue- 
prints shaped around such objectives^ module writers arid reviewers 
can direct their efforts at the precise content that will help users 
accomplish these aims. 
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8, Identify the reporting considerations for your own 
situation arnd develop a plan for reporting evalua- 
tion results using communication strategies appro- ^ 
priate to the considerations you have identified, 



Module Objectives and their Puryoees 

Each module has a set of objectives that incorporate the parti- 
cipant outcoiDes listed above and serve at least thtee purposes, First, 
they direct the module design and wrj^ing activities* The module 
developers do not begin their detailed work on content until its ob- 
jective^ have been agreed upon and stated in the most measuratj.e form 
possible at that point in the "development sequence. Like anv beh^ini 
al objective, each statement in the set must have four parts; (1) 
indication of who should be able to perform the objective (that is 
easy in this case* since it will be the staff persons experiencing 
the module); (2) the outcome those persons will be able to perform 
if they achieve the objective (two types of outcomes, knowledge and 
skills, are listed in the preceding section); (3) the conditions 
within which such outcomes will occur; and (4) the standard(s) that 
will be used to judge the adequacy of the performance. With blue- 
prints shaped around sucb objectives, module writers and reviewers 
can direct their efforts at the precise content that will help users 
accomplish these aims, . 
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A second purpose of module objectives Is to serve as guidelines 
for the learning experiences of the participants. Each module's set 
Is presented In simplified form early in the module. At that point, 
participants are encouraged to study the objectives closely to deter 
mfne what they srre expected to accomplish .In that module. After 
reviewing the list, If they decide they already have achieved those 
^ms, or are not Interested In working on thetSi the workshop coor* 
dlnator helps them explore and engage In other staff development op- 
tions. If they agree that some of the objectives are appropriate 
for them, they are encouraged to direct their attention only to the 
module sections that deal with those selected. Since a complete 
statement of one objective can be lengthly, a list of such state- 
ments can be unnecessarily frustrating If It Is one of the flrst^ 
things participants encounter when they begin a module. Therefore, 
the simplified versions presented at the beginning of each module 
omit the criterion standards used to assess participants' perform- 
ance. These criteria are provided In a Coordinator's Guide that 
accompanies e«eh module. Workshop partlclp^ts Interested In re- 
ceiving these standards before they proceed, or during their worH 
on a module, ask their coordinator to share the set with them, 

A third purpose of each set of module objectives entail eval- 
uation. One of the conc^ludlng elements of each module Is a perform- 
ance test to help participants and coordinators determine what 

\ 
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objectives have been achieved as^well^as w^ch one require addl^ 
clonal attentloni This type of evaluation 1^ strongly leamerr^ 
based. The objectives can also help the developers^of ttT€~3late- 
rials and procedures evaluate which parts are working^ and whlcR\ 
ones, need further modification. In addition^ these ofijectlves can 
be used to evaluate t^e long^-term effects of the staffs developments- 
results that occur after the workshops and_.that ma^ be dlffei^ent 
from t;he Immediate effects measured' throug1| module test^. 
Module Objectives Exaisples 

TVo types of pbjectlves, and their component outcomes^ are 
employed In the staff development modules, The first, Itnwledge 
objectives, are the ones on which conventional In-^servlce approaches 
generally focus ^ If efforts are made to state explicit predetermined 

objectives for them at all (which Is usually not the ^ase) # It Is 

J* 

the second type, skill abj€ctlves^ that Is the distinctive feature 
of our staff development. As Implied earlier In this chapter^ AIR 
personnel Identified critical tasks that experts fdlt educators 
needed to perform In order to plan, develop, Implement^ and evaluate 
h^an servt^ces programs effectively, 71«<^n_, the, competencies that 
educators r**qiilred for '^firr*'':^ l ji1 1 v rH^iKhn t f it:> Mi<^<^r» tn<;ks were spe- 
cified, Noxr, re),iifrt I riu i PS wt-n^ >;i*ou)»tNi <o tli.tt^'n moduler^ 

Co»| Itr iff* O Jul' * ^^r- y\ If r- \ r < n Pm **** r^f Mi*' m*>^ J , riinr!nTti<^nt ,T 1, , 



objectives that each module development team could then use to 
^direct their design and writing activities. 

The skill type of objectives outlines the most important 
participant outcomes that each module attempts to achieve. 4Me 

tnowledg'ig objectives summarize" selected^ coignrttve^irrcomes ttrOT 

are prerequisites to the performance of these competencies. Four' 
examples of such knowledge objectives and the modules in which they 
are found are follows; 



Module 4. Define "current status assessments^' state its emphases, 
and explain hw it fits into the needs assessment process. 

■ Criterion: l!he de/finition should state that the current 

status assessment 'determines what a program is and ^ii as (what its 
i resources are and how they are used). The desiredloutcome 
^ , assessment determines what an ideal program would pe . The 
discrepancy between :these defines the need. 

\ 

\ 

\ 

Module 5. Define^ the phrase "program goal" and give /an example 
ot one . 

Criterion; The definition should state tttat goals are 
general statements of program outcomes. They fire not specific 
and behavioral. , / 

A feasible goal should be presented, it/shpuld' meet the 
six criteria defined in the module 

Be at an appropriate level of generality* 
' Be focused on students. ' , 

^ " ^ Be written iti cAenr^ direct language. 

Be directed an outcome^ not a process. 
Be suggestlvt? of riie i vt>^^55 of outcomes to which ' 

I^ef lect tUe urnlt^r lying-* rfOmosophy and theory intended . 



\ 

\ 



ERiC 



92 



89 



/ 



ERIC 



\ 



Use your judgment in evaluating the example, The last criterion^ 
*for example, may be hard to satisfy in a given objective, 



Module 6, State the reasons for and the Importance of writing 
career guidance student performance objectives* 



Criterion; TRe rationale defined shoufd Indicate tTiat 
writing student performance objectives helps structure learning 
in the program* and facilitates the evaluation of the program, - 
Participants may also Indicate original ideas or locally 
appropriate points • 



Module 8, List the advantages of writing process objectives* 

Criterion; Advantages listed should include the fact 
that theS^ help you to clarify your thinking^ replicate the 
project* report on the project^ and manage the project. 



In the 12^module series on which this chapter focuses^ a com- 
petency objective is either an enabler or a terminal type. All of 
them entail skills that can be operationall^ed by observable per- 
f ormances , preferably ones Inditated by the successful development 
of a product having measurable relevance for practical settings. 
We have attempted to concentrate on helping participants lnternali2^ 
skills that are generalizable^-ones they can use in practical, set- 
tings ojLitside the instructional and testing settings provided by the 
modules, Module 6^ for example^- contains three competency^-based 
objectives that serve as enablers for the more Important fourth , 
and final* skill. These three are; ^ 
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1. Wrlta an outcome itatlng an riUntlf lable performance for 
a gcfal statement^ll 
Criteria; 

The exampldjfc provided by the participant must meet 
four criterfla listed in Activity 1^ follows: < ' 
Are the oiaxcomes observable performances or behaviors? 
Are the valrbs primarily action verbs? "A^^e the out- 
comes subject to few interpretations? ^ 
Do the 'Oulcomes actually give evidence that\the 
j participgjit has reached the goal? \ 
^ Is the bdnavior in the outcome aa important or^ig- 
nif leant /one? Is it worth knowing about?/ \ 
Do the c^tcomes describe what students will be abl^. 
to do> not what will be done for students? 

If any participants fail to meet these criteria^ point 
this out and have them keep working until they can write 
acceptable examples o^ outcomes. Each participant must 
write three correct outcomes In each case. 



Urite^ or select and modify, five full objectives from 



outcomes. Each objective will contain the three compo- 
nents of a good objective. 
Criteria: 

Each of the objectives individually written In 
Activity 2 must: 

Indicate the'audience to whom it is addresse<i. 

Specify the conditions under which it will be evaluated. 

Indicate tlie criteria necessary for success. 

If any participants ffiii to include all these parts in 
Liielr objectives, pnitii oiU wli.it ones iliey .^re omitting and 
licive them keep working until i fiev do complete five accept- 
;ibie objectlvr.q* Ft m.iv bi^ u'^-f^ful u> li.ive participants 
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3t Produce a sequenced list of all objectives pertaining to 
a given goal statement and target population. 
Criteria; 

This outcome is measured three times vithln the module:^ 
twice in one of 'the activities and once in the postassessment 
In the former Instance, two lists of jumbled objectives must 
be organized and fit into classification schemes, and the 
Correct answers are contained in the criteria. On. the post- 
assessment a scheme must be described^ a rationale for it 
provided which is reasonable according to the coordinator's 
judgment^ and a set df objectives previously drafted by the 
participant arrang'ed within it. 



The skills Involved In the above three statements are crucial to the 
construction of measurable objectives th^t are developmentally se- 
quenced. However, the module attempts to help participants to further 
and state such objectives for tilelr own programs. Since participants 
will not conduct needs activities^ In their educational settings until 
after the workshop, they do not have the input data they need to write 
their program's objectives when *tt>ey complete this module* Therefore, 
they check theii? terminal comp^ence with their workshop coordinator 
after producing a detailed plan for exactly how they will state their 
objectives later* The terminal objective related to this competency 
in Module 6 Is as follows: 

4. Produce ai plan for developing student performance ob- \ 
Jectivef^ for >tour program. 



Criteriaf ^ 

The time^and task analysis produced sKould outline 
the tasks under each of the. major headings listed, assign 
responsibility ^for each task to someone, and s^t a com- 
pletion date for each task* In addition, the plan should 
be reasonably ; 

Logical - do the tasks fldw in logical sequence? 
Thorough - is it detailed enough to be helpful? 
Feasible - is it not too detailed to be burden^ 
some? are the times allowed for the tasks rea- 
sonable? 

Fair - are' the responsibilities assigned equitably 
and fairly? 



Module Format 

The design specifications of our modules have evolved through 
pilot (preliminary^ small group) and field (more intensive, large 
group) tests- in which we have been involved over the last two years. 
Each module is composed of a package of materials including: a con^ 
summable module booklet for the participant, a reusable guidebook 
for each workshop coordinator wqrking with participants on that 
module ^ and support materials (e.g. , films trips, textbooks , journal 
articles, sample ttsts and assessment instrifments) referenced to" 
variotjs sections and objectives in the module. E§ch coordinator's 
guide contains definitions of the workshop leader's roles and func- 



tions and provides inf orm.^t i on ht-lpfn! tf^ t lie" por Korm.mce of those 
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Each participant's booklet begiM with a section that; (1) In- 
troduces the general'goal and specific participant outcomes of that 
mMulej (2) outlines the activities covered by the module » the*apprpx^ 
Imate time that should be allowed for each activity, and th^.-^ 
outcomes keyed to each activltyj {iS llltistrates hov the content of 
this module fits into the comprehenaave program plaanlngr^evaluation 
tflodel that serves as the fotta^at^n for this staff development series; 
and (4) provides a glossary defining Important terms used In that 
module • 

The four remaining sections Include! (1) the main- text for 
In-depth reading Interspersed with both questions for group discus- 
sion sessions and practice activities; (2) a poetassesssent , criterion 
test for performance feedback to each participant; (3) the aforemen- 
tloaed personal application that encourages participants to apply 
their acquired knowledge and skills to problems in their locSl set-^ 
tings; and (4) an appendix of materials helpful throughout the 
module , including an optional simulation description for discussions 
of real life application of the skills; additional readings/materials 
related to the module s topic; and bibliographic descriptions of 
key references related to the module's content,' Participants' book- 
lets range in length from AO to 80 pages, wtt+i an overall total of 
approximately 800 page? for rfic* \2 modules* 
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Foraat Examples 

The tdble of contents displayed in Figure 8 on the next page 
illustrates how the above specif icatioos are integrated with the 
content to fora the participant's booklet for Module 6» For that 
same module > Figure 9 on page 97 Indicates how the participant is 
apprised of the various module sections, the suggested time intervals 
for eachp activity > and the relationship between those activities 
and that module's five outcomes* 
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Figure 8 
Table of ContQta for Module 6 



INTRODUCTION 

Module *Goal and Outconjes "-""—-"^-f-— 

Module CXitltne — j — .-,^^^^,j^p,^-^^«^ — ^ — .r^„^p 

Model and Module 6 ^:^-^-^--^^-l*^r^r^^^-'w^^-p,^-— i-p,— ^- 
Glossary .r-P^^-^^-^--— „^-^^-^p,r^«^^ — -^_p,*. 



TEXT 

Why Write Objectives r-i 

Dls cues Ion of rationale — — ^--^ — 

Determining Student Outcomes ""^'^ 

Types of objectives ^ ^-,_-^-««p,,.«„-^^*-,p,p. 

Specifying outcomes p,^„-_p, p,p, — — p,-^ 

Activity 1 ~ Determining student outccmes — 

Producing Full Objectives — — p,«-p,p,^-^ — ^p,—-^-.^-,^ _ — 

r f 

The audience 1" — — ^ 

The behavior ^-L . i 

The condlt Ions -^"-^ — 

/ The degree — — -pp,-*. 

' Discussion of factors in objective writing — — - — 

Activity 2 ^- Producing full objectives — ^ppp,^ 



Using >Wallable Banks ef Objectives r: 

Sequencing^ Objectives — — ^^—^ — ^„-^^„^^ — ^^-^-ppp„_^ — 
Dlscd^lon of sequencing and uslng^ objectives 
^tlvlty 3 Seqoenclng objectives — ^_^„«pp 

POSTASSESSMENT ' 

APPLICATION ~ — ' — 

APPENDIX 

Optional Group Simulation Description — — pp— — 
References — — — 
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Module Outline for Module 6 



Approximate 
Time 



Activity 



Out^iomes 



1 hour 



Introducticn 

Group activity based on module's 
goals and outcomes » The coordinator 
will explain the structure and pur^ 
poses of the module. Questions and 
discussion included^ Tape^slide 
presentation. 



3 1/2 hours 



Text 



1-5 



1/2 hour 



Presentation of the Important Infor-* 
matlon related to writing objectives. 
Discussion sessions and practice 
activities interspersed . 

Postassegsment 

Assessment of your acquired knowledge 
and skills. 



1-4 



1 hour 



Application 

Planning for the use of these 
abilities In your awn setting, 
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IVo other participant . boofciet sections that probably should 

be Illustrated are the practice activities that follow theVsijort 

j' ^ 
reading topics In the text^ and the personal application thaD serves 

as the Important conclusion to each module, Figure 10 on page 100 
provides an examplfe of one of three activity exercises contained In 
Module 6, It asks workshop participants to practice analyzing and 
writing student objectives. For that same module^ the two pages of 
Figure II (see pages 102 and 103) Illustrate how we use the '^Appli- 
cation'^ section In each module to encourage participants to apply 
the skills they acquired to program development problems In their 
own school situations. Th3 coordinator for this module assesses 
participants* ccispleted products of this personal application. 
This assessment process determines the degree to which they have 
demonstrated the terminal skills of the module, provides constructive 
feedback to help them bring their performance to an acceptable level^ 
and certifies when that level has been attained and all module ob- 
jectives have been met. , ^ 

} 

In-Ser vice ?1 lot Te< ts 

, r— — ^* 

t 

During the 1974-1975 si:hooI year, this staff development approach 
was pilot tested In a three*-4ay workshop setting wl^th 16 counselors 
from the San Francisco Bay Area. At the same time the 12 modules re- 
ceived s professional review frOTi staff members In the Guidance Divi- 
sion of the California State Department of Education, as well as five 
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national experts In the field of guidance, counseling, placement, 
and follow^through, Ihe purpose of this pilot test and professional 
review was to collect feedback on each staff deve lapMat module and 
the overall workshop procedures (e*g*, participants' selection of 
modules* coordinators' roles, module testing activities)* Ihe in- 
formation collected was then used to m^fce improvements in all mate- 
rials and procedures so that extensive field tests with larger groups 
and more detailed follow-up evaluations could be^ scheduled for late 
summer, 1975 . . . ■ 

^e results of thesfe trial attempt;s .were essentially positive* 
Hcwever, sufficient constructive reactions w«re obtained to warrant 
A major .revision * We classified these criticisms into two categories* 
The firsl group included the con<^ns participants had relating to 
this type of individualized, aompetenqy-based ^ staff development work- 
shop. This was a novel expe^^nce for them and not one for which 
they felf well-prepared, from the standpoint of both knowledge and 
motivation* The second category of concerns focused on the delivery 
system we used in the workshops. Ihe materials needed to be more 
palatable to the participants and more self-motivating* To respond 
to the first category, we decided to devote more effort interviewing 
potential participants before the beginning of the workshop and then 
orienting those who want to participate and are selected* Ibis ad- 
ditional effort wou'lrf attempt to; (1) convey fully the advantages 
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Figure 10 

Activity 2 - Producing Full Objectives 
\ (Module 6) 

As a groups determine If any of the four compooents are tnisslng 
In the following "objectives," After each statement below, write "A/^ 
"B," "C," and/or '*D/' depending on what Is mlffslng. Write "None" if 
all ^e components are present, 

1, Ihe tenth grade student will have an awareness of th^ 
changes 1r sex stereotypes In occupational choices* 

2, To be able to describe the difference between an ability 
and an interest in a written paragraph which will be 
evaluated by the teacher* 

3, When given a list of occupations^ all third gride students 
will be able to Identify those which are service occupations. 

4, ^n a 15-^ to 20*iDlnute Interview with the counselor, gradu- 

i 

atlng seniors will be able to des'crlbe their plans for the 
first year out of high school. Each senior must Indicate 
to the counselor's satisfaction that s/he has carefully con- 
sidered available alternatives for post-hlgh school educa- 
tion and training. 
For each "objective" above which is missing one or more compo- 
nentt., rewrite It (as a group) to include a11 components. 
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Now^ working individually j write an objective for each of the 
following student outcomes, 

!• ^'^.tell in her/his own words the dlfferen^ce in working 

conditions; s/he observed In different parts of the plant, 
2, , , .Is able to select two persons from history and discuss 

why s/he would like to emulate thetn. 
3* ,**can Identify most occupations In the community* 
A. *wcan state Important self-characteristics, 
5, ,.,can select Important criteria of job for own satisfaction* 
For each of the objectives, underline the audience or target 
papulation once,' the test conditions twice, and the degree or criteria 
three times* (Ihe behavior or outcome will -not be underlined,) 
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Figure 11 
Application far Module 6 

You are now ready to map out a plan for applying the skills you 
developed In this module to your own setting. Thinking of the sections 
of the module and the questions you have' discussed, consider the tasks 
that must be accomplished to, generate and sequence student performance 
objectives for your progran^ the person who should be primarily respon- 
sible for each task^ and'the date by which the task ihould be done. 
Since student performance objectives must be written after the goals 
have been established^ and before strategies for meeting the goals and 
objectives are determined^ the dates you choosfe must c[oordinate with 
those set for other program planning tasks. If possible^ this exercise 
should be done under the direction of someone from your district who 
would be good at taking charge of this effort and who would like to do 
it. Use the chart on the following page for listing your tasks, the 
people responsible^ and the completion dates. The major headings are 
already noted on the charti Use additional paper as needed. 
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Application 



Tasks 



i 



Indlvldusl(d) 
Responsible 



Completion 
Date 



I. Establish In the necessary people the 

motivation to specify student performance 
objectives for the career guidance 
program 

(tEkore spsce Is provided In 
the participant's booklet 
for esch of these sections) 



II. Determine student outcomes for the 
program* 



III. Produce full objectives for the 
student outcomes. 



IV. Establish and use a sensible 
sequencing system for the 
objectives , 



■ / 

axid disadvantages of the program plaonlng and evaluation model that 
this set of modules stresses^ (2) Identify our staff development 
assumptions^ and, convey them to participants before the selection;. 
i^) explain just how much hard work Is Involved and the kind of com- 
mitment that this staff development approach demands; and (4) ^select 
highly motivated participants* 

Oil the other hand* the following major actions are beljig taken 
to revise module format and content to effect an Improved delivery- 
system: ' * * ' ■ 

1* Edit each participant booklet to make It slmpller and 
more .stredmllned, 

2» Produce an Improved Modu2:e:,2, relying more on a*tape- 

slide Introduction^ verbal presentations and discussion, 
and less on reading 

/ 

3* Change the format to have smaller sections of reading, 
with each followed by a brief discussion period and the 
activity pertaining to that section* 

4* Change thre preassessments Into outlines of. each module^ 
useful as pre-reading aids* 

^ ■ - 

5* /Modify the simulation so that either a hypothetical 

case s&udy Is available or partlclp^ants can use their 
» own school setting fx)r the discussion* 

* * 

6* Spread the >£a&ercl&es through the text, leave In only 
essential ones, -personalize Chem where possible^ and 
call them activities* 

' 7* Move the discussion questions relating ^ participants* 

own setting In the Application section to the appropriate 
section of reading* Leaye the task of mapping out a 
> ' ' plan for using the skills ih the present Application* 



107 



104 



and ^disadvantages of the program planning and evaluation model that 
this set of modules stresses^ (2) Identify our staff development 
assumptions^ and c on them to participants before the selection;, 
(3) explaln^^j«tf^^^ much hard work Is Involved and the kind of com- 
mltm^t that this staff development approach demands; and (4) select 
^^Ighly motivated participants. * 

On the other hand^ the following major actions are being taken 
to revise module format and content to effect an Improved delivery 
system: ^ 



I, Edit eadh participant booklet to make It slmpller and 
more streamlined. 



2* Produce an Improved Module 2^ relying more on a tape^ 

slide Introduction^ verfeal presentations and discussion^ 
and less on reading. 

3. Change the format to have smaller sections of reading, 
with each followed by a brief discussion period and the 
activity pertaining to that section. 

4. Qiange the preassessments Into outlines of each module^ 
useful ds pre-reading aids. 

5. Modify the simulation so that either a hypothetical ' 
case study Is available or participants can use th^lr 
own school setting for the dlscdsslon. ^ ' ^ 

6. , Spread the exercises through the text^ leave In only 

essential ones, personall ze them where possible^ and 
call them activities. 

7. Move the discussion questions relating to participants^ 
cvm setting In the Application Section to the appropriate 
section of reading. Leave the task of mapping out ^ 
plan for using the skills In the present Application. 




8, Make the Glossary more accessible^ expand this where 
necessary . - , , - 

9, Improve layouts of all materials, Add boldface type j 
and boxes. Use color coded pages for discussions 4nd 
activities * ^ ' 

^ — 10, Thoroughly edit all modules to eliminate jargon, lighten 
the tone, and clarify the style* 

11., Add more examples^ summaries^ textual humor, and cartoons. 

12. Segment, expand and professionalize the tape-slide. 

13. Make fuller use of coordinators in conveying the basic 
idea of each module t ' , 



The above. tapdtfications ar^ being implemented to ensure better prod- 
uct« for the field test scheduled in late summer 1975, We believe 
the pilot test and p-rofeasional review helped .us provide an improved 

' ■ ■ . Vy' 

Staff development approach for this s6t of modules and for any sub- 
sequent pre-- and in-service staff" work we attempt. Hopefully^, other 
educators of human services personnel will be able to profit from 
our learning* experiences , too, ^ A few of the recommendations we would 
make to these educators ^re summarized in the next section. 



7.. 

to Staff. 



Recommengiatlons to Staff .Developers 
Many of the pitfalls we experienced undoubtedly are not unique 
to this type of modularized, ccjmpetency-based-staf f development ap- 
proach, Becatise we believe that we have learned some generalizations 
that would apply equally to your staff education setting, we ekpress 
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as recommendatlotis for your considetatiOD : 

It is Important that participants in such workshops re- 
ceive an early orientation to the purposes and procedures 
of the subsequent trainirrg experiences. 
Each module should be short and succinct. 
Reding should be kept to a minimum, 
Unnecess^^^jjargon should be eliminated. 
Preassessmeilt activities should be carefully designed^ 1: 
used at ^ I^e ones^'we used to h^p participants deter- 

mine their kxicvled^ levels before they started major module 
activities uere'tod specific to the niodule content and were 
too f rustrating^jlnce participants ^variably could not 
answer the questions correctly. , 
Similar caution should be adopted if simulation activities 
are included. We used them to help participants practice 
theix' skills on a predetermined practical problem for which, 
correct solutions could be developed. However^ they seem«d 
too "canned.'' Participants were nK>re anxious to practice 
on their own school problei^sTh^k^on contrived examples. 
All ref^enced materials should bp easilv integrated into 
'the participants' booklets so that access to them is not 

/ \ • ■ ' 

/ too cumbersome and confusing. ' ^ 

] 
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Personal application exercises should be spaced throughout 
each inodule. Initially^ we placed these applications at 
the end of each ntodule, Hcruever, we learned that this de- 
layed them too long, Participants wanted to apply their 
nodule competencies to their own school settings auch 
earlier in each module* ^ 

ProbleTns with tfals Staff DevelopipeDt Approach 
Even aftfer reading the preceding section ^ In case you still are 
not convinced that this approach does not involve major problenis^ we 
decifled to conclude this chapter vi th a brief 'xevlev of soioe of the 
nore c^tlcai issues with which we continue to battle* Ihese lissues 
are not ones for which V€ can make general recommenrdations at this 
*tii!ie^ as we have done In the above section. However; we summarized 
^ these concertis here because we think they have general relevance to 
any staff development! ptogram. In addition^ we ho^^e their discussion 
wi ll facilitate the planning activities of other researchers and 
educators who are exploring slailar staff development alternatives • 
'Rie most' nagging concern we have f«ced throughout all aspects 
of our research and development in this area entails participant mo- 
tivation* Most of our participants to date have experienced our 
approach in an Inservlce setting, Our current perc^ftions are that 
nany such* personnel are accustomed to staff development activities 
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in which they (1) do not have to btf too actively invj^lved / U) do 




not h»ve to work too hard, (3) can be entertalned/oy powerful epeak- 
ers and glossy audio-'visual and printed materials^ (A) can spend a 
lot of time talking in group discussions ^ (5) have few reading and 
product development tasks requested of them^ (6) can follow workshop 
leaders who assume a controlling role^ and (7) are n*ot accountable 
for increments in the workshop performance.'^ 

As we hope it is obvious from the preceding sections of this 
chapter^ the delivery system of our staff development approach con" 
tradicts most of these preferences* This approa(:h attempts to en- 
gage participants in a learning process that emphasizes: (1) indi- 
vidualization; (2), learner responsibility for personal growth; 
(3) more independent, self-instnictional activities than many par- 
ticipants desire and are accustomed toi (A) participant generation 
of specific products that will have transfer ij^luev.io their practi- 
cal settings after the workshops; (5) few didactic presentations 
and lectures and more reading and*self-study activities; (6) a 
facilitator^ rather than a leader^ role for workshop coordinators;- 
and (7) performance assessment of gains participants make in their 
knowledge and skills as a result of these learning experiences. 
Needless to say^ we have experienced motivational problems with 
many of our participants. In response^ we have; modified our delivery 
system as much as possible ^^o thai we can maintain the learning 
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principles in which we believe ■ At the same time, we are coGmitted 
to a mission of trying- gradually to change participants* staff develop- 
ment expectations to more specific, measurable, and higher goals than 
they have adopted in the past • 

A, related problem with our delivery system' is the anount of 
participant instructional time it requires, Ihis type of modularized 

approach reinforces individualization of learning experiences to the 

* 

needs and characteristics of learriersj" but because it is designed and 
evaluated on the basis of measurable objectives, it also requires 
that participants receive specified learning resources to achieve 
agreed'-upon performance levelSt, The instructional? material* and 
procedures have to "(ieliver/* Therefore^ parti^pant ^ime for ex- 
posure to appnropriate learning experiences ^becomes a very important 
ingre^lenW We began with modules that necessitated ten to fifteen 
hours^f learner time. Even though, as was merftioned in Chapter 11^ 
we have tried' to extinguish *all attempts to present our program plaa- 
ning-evaluation model as a lock-step series of sequentially related 
activities^ we have had to deviate from this goal in our staff develop- 
ment* W^'know that participants who are beginning their experience 
with this model must first be exposed to certain fundaijental coh^ 
cepts before they work , on some of the more sophisticated skills* 
Ihls meant that each participant agreed to take three or four modules 
Ihe total time coomltment became Impossible In many human services 
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settings. As a result we have reduced the module time for the 
typical participant; the average time is now six hours per module, 
However^ for in-service education we continue to ask each partlcl- 
pant to comcDlt to at least three modules, Therefore, this staff- 
development approach Is not feasible for )iuman services personnel 
who cannot devote at least four days of learning time to the process, 

A third problem also relates to motivation and time issues, 
Ttils entails participants* reluctance to engage In evaluation actl- 
vltles aimed either at helping them assess changes In their perform- 
ance levels or at assisting us to improve the staff development 
mat;erial& and procedures. Usually^ they have been more supportive 
of the second evaluation purpose than they have of the first, A 
central concept In our approach Is a dedication to specifying In- 
structlonal objectives and meas'urlng progress toward them. However^ 
many of our participants have Jiht shared that dedication^ Some of 
them seemed to have felt threatened, particularly by any preassess- 
ment activities Intended to help th^m assess changes in their perfortD- 
ance* They weW dem(?^allzed by their entry level 'assessment results 
and frustrated ;hat our itema^wer^ tailored faf'too closely to 
module content. As a result, we have abandpned the preassessments 
and are focusing more attention on criterion-referenced evaluations 
at the end^ and after^ the workshop^ Other participants^ anxious 
to emphasize , learnlng^xperlences^that had Imflifedtate application to 
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their practical job settings, felt that evaluation activities diverted 
then from this main purpose. We have therefore reduced the number and 
extent of the evaluation instruments and procedures but also have re^ 
affirmed our dedication to trying to stimulate participants to adopt 
more positive attitudes to the aims^ process^ and results of the eval-^ 
uation of any staff development approach* 

The most important aspect of evaluation of our staff development 
is the measurement of changes in participants' competencies. Solid 
criterion^referenced evaluation requires that skill-based objectives 
be assessed by instruments and activities that ask participants to 
demonstrate their performance of competencies outlined in those ob- 
jectives^ and tke products that result from this performance. Because 
our approach stresses the acquisition and practice of competencies 
*hat are transferable beyond the staff development setting into each 
par<lcipant's practical job setting* pencll-and-paper measurement 
items will not suffice. Indeed^ we gave up our earlier emphasis on 
assessing each particlpant*s competeOce in solving contrived problems 
through simulation experiences. One reason for this change was 
participants' concern about the artificiality of the simulations and 
their preference for more personally relevant assessments. We are 
now concentrating on the personal application plans described earlier 
in this chapter, and post workshop fdllow-up evaluations of the 
degree to which such plans are implemented- However^ this tactic 
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incurs the participant time problem again and is expensive to conduct. 
Obviously^ we have not completely resolved our competency evaluation 
problem. 

The final issue entails our desire to produce staff develdpment 
training that is equally appropriate for pre-service and in-servif:e 
settings. Ihus far^ most of our effojrts have ^;oncentrated on in-ser^ 
vice education. However^ we are fully aware of some critical issues 
involved in generalizing our staff development approach to college 
and university programs. Some of the strategies that need to be 
worked out include: 

1. Strategies for conducting tasi! and competen^cy analysis ^ 
for determining generic human service skills. 

2. Strategies for conducttfig-jCQmpetency assessments to 
determine : • ' 

a. what students to admit to human service^ education 
'^t the gra^duate and undergraduate level* 

b. how to develop 'individualized programs of study 
tailored to thef interests and needs of each 
student accepted* 

3. Consistent procedures and formats to be used by all depart* 
ment members in the competency training of these , students , 
Strategies for performance evalu^tion-of student progress 
on individualized programs of study, 

3* Strategies for changing state credentialing requirements 
to be compatible with a campetency^based certification 

iio 

112' 



model developed through such an ^ducatlonal program, 

6, Strategies for implementing information management ser- 
vices to suppott such compe tency^b$sed lemming* 

7, ^ St-fategles fot follow-<jp evaluation of the job perform- 

ance of graduates and, therefore^ the human services 
ry educational program, 
^ 8, H^ntalnlng T^curr^t task and competency analyses to 

ensure tfiat such programs focus on <:urrent competencies ^ 
appropriate to p^^actlcal settings* 
We do not expect to solve these issues without a he$vy commitment^ 
^but we do anticipate working on them ovet the next few years,. 

Summa ry 

Ihls chapter reported the procedures and results" of our recent 
attempts to develop , pilot test^ revise, and field test a competency- 
based staff development approach, Different components and products 
used in tys staff development alternative were illustrated. This 
approach aims at helping human services personnel acquire and prac- 
tice identifiable knowledge outcomes and skills they need In order 
to plan^ develop. Implement, and evaluatevsocial action and education- 
al programs by employing the systematic model and process brl^ly 
reviewed In Chapter !!• 

Also discus^^d here were recommendations for improvltig this staff 
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development approach, as well as unresolved problems Involved in its 
implementation and evaluation. Possible solutions to these problems 
were suggested. The need for integrating this type of in-service 
staff education with pre*^eTvice programs was discussedp as were ob-> 
stacle^ that may hamper such articulation attempts. 

The next chapter addresses the. need for client programs that 
are compatible with the Giapter II pianning-^evaluation model and 
the Chapter III staff development approach. Example strategic? and 
materials jused in a small sample of such programs are presented in 
sunpary form. Resource persons who can provide further information 
are indicated for each program Introduced. 
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This chapter dealt with the process of selecting and developing 
guidance and educational activities for clients. The process con- 
stitutes the second phase^ Program Development^ of the Systematic 
plannlng^avaluatlon model Introduced In Chapter II* Some existing 
client programs are described as examples of this phase as out- 
lined on Page 21. The programs selected are only Illustrative 
and not exhaustive* 



Chapter IV 



Using Cdmpe^ency "Baaed 
Client Strategies And Haterlsls 



Program strstegles^ materials^ actlvltl^ and curriculum for 

/ 

clients are means to endet^ Ibey ara meth^s or procedures for ac- 
complishing certain goals or objectlve^^ Before you determine" whkt 
methoda or procedures to use with cHenta (or what curriculum to 
write or what materials to select), therefore i you should prefsce 
thst decision with the plsnnlrig^^valuatlon process detailed In the 
last three chafiters. 

Consider, for example^ the counselors counsel** attitude dis- 
cussed li) Chapter I. .^.Individual counseling (one-to-one relationship) 

\ 

Is a strategy for achieving some purposes. It Is a method, a pro- 
cedure, an activity. It la a means to an end. It Is also whst most 
couneelofi are trained to d^ It la what they want to-do; In fact^ 
AoaC counatlorf feel It Is Ch^r 'V^rpose** for being hired. In a 
sense, counseling becomes the eii^. Of tenat^ool-baaed programs re- 



flect this attitude In counaellng iiandbooks. Typical statements 
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read as follows; 

"every student will receive Individual 
counseling'* v 

' "each student will be counseled Individually 
^ at least twice every semester" 

"counselors will spend at least 50% of their 
time counseling students Individual ly*\ 

' Unless the plannlngrevaluatlon process precedes the selection 
of human services strategies or activities^ It Is difficult to 
determine their value. In other worde^ unless It Is first known 
what outcomes are desired^ It Is difficult (or Impossible) to deter- 
mine If counselors* Individual counseling with students Is a valu^ 
able use of tlma^ Is Individual counseling likely to achieve the 
desired outcome? Is Individual counseling more likely to^ achieve 
the desired outcome than are other methods? Does the guld^^e staff 
hdve the skills to use other methods? ^ 

Selecting and/or developing activities for clients^ therefore^ 
Is part of a total process of planning^ developing^ Implementing^ 
and evaluating^ When human services personnel decide to counsel^ 
lead groups^ present a curriculum^ set up a career center^. provide 
job placeiaent or offer any services to clients^ they are choosing 
from a variety of possible strategies that they hope will accomplish 
something. Obviou^ly^ this declsloi^- (selection of a strategy) will 
be more productive If It Is based upon criteria more precise than 
%ope'' anil "something." ^ 
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The previous chapters have described the need for and the skills 
Involved In developing this "precision. Clearly established needs, 
program goals, and performance objectives will define the. "something 
to be accomplished" and will make It easier to determine the llkfill- 
hood of success beyond hope* Nevertheless, selecting the **best" 
strategy ,to use presents some other decision problems. 

In addition to the questions already raised^ as a prog|:am de- 
veloper you face an additional serious probjlem. In ord^r to chooae ' 
a best strategy, you must know about several/ alternative "good*' 
strategies from which to choose. Knowing a number of good' strategies* 
Is a major problem. 

Today, many new strategies -are on the '^market. * These Include 
Interpersonal techniques (human relations skills^ vuue clarification^ 
assertlveness training, etc.) as well as "packaged curriculum** for ^ 
clients (programmed materials, multl medla^ etc.). O^unselors, teach"- 
ers , and others also have written their cwn materials riojr ^^^^ adapted ' 
published materials for their use. But even with .cleai^ly Refined / ^ 
purposes and objectives, a counselor may fall to choosers'' certain 
strategy or set of materials simply because^ it Is not fcnWn. 

Ihe rest of this chapter lists some sources^ of Humai^ services 
strategies and provides flome drtAils on ^i /few examples.^ (Those 
strategies <;elei:ted <ire on!v I I lusl r;j t ( ons and *n no wa^ ^re In- 
tended to be an ^'xfiatiflLivi? n\ roh^iMtrcrh^ ^) ip\ey hbvp' been 
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tailored to^^Jtlents in ^^iw^ settingej ho\(ever^ they 4l6o-'$h6uld 
pTcf^^iik iliustrarj^ijs for htrmdn services personnel yorWing^n cither 
educatimJ<and social agencies,^ Ihe examples and the' ^ist of 'sources 
iy help in knowing about existing guidanoe strategies** Ihey do not 

, m * 

help in knowing how to choose the '*best" strategy. Knafring how, to 
choose strategies and materials is a process that involves basic 
skills and competencies that need to be added to those. discussed in 
the first three chapters. 

As a program developer, when you look for the means to achieve- 
the objectives of ,a well-planned program, you would lik6 to be able 
to cgnsider an array of possible strategies where the following kind 
G|^data are available: * 

I, What outcomes does this o^frategy attempt to achieve? 
What target populations does it serve? 
What staff, f acilit^tgs^^..--iit^^ and time are needed 



2. 

» 3. 

b 

5. 



,What procedures are used? 
How well does it achieve the outcomes? 
Where can I find out more about it? 



UnforCunately, strategies ^and materials for human services are 



not normally researched^ d;esigned^ and packaged in ways that mak^ 

- - / 

these answers easily available , to program developers. On the other 



and» the answers to many of th^se 4fpestions may be idibsyncratic 
tt3 your own^&etting. Therefore, yoij may need to find some answers 



locally. 
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Llkewi^^^ since a well^-^lanned program In a particular dls- 

trip<^or locale probably will require the development of "taljfer'^ 

i 

made" stra'tegles, some adaption^ modification, and/or supple- 
menting of published programs wlil^ no doubt^ be required* However^ 
what follows shoulxl be useful wh^ you 'reach the state of selecting 
^strategies , 

Several guidance strategies and s«ts of materials are discussed 
as examples of human development programs that are available to edu- 
cation and guid^ce personnel* %ose selected for illustration are 
examples of programs '^tfi^t-i^ght be useful as means to achieving goals 
and objectives in the general domain of career education and career 
guidance. As the end of this chapter an annotated listing of resources 
^or additional suggestions is included, , 

Example Prof^rams ' ' 

Seven student programs will be reviewed* The following format 

will be used in order to provide some uniformity to the review and 

to help provide the kind of answers you lad other program developers 

will seek when selecting strategies. The resource person Is listed 

for cases where more extensive information about the total published 

program may be desired* 

Overview; What it is, intended target population, and materials 
involved* » 
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Goals and objectives; Ihe staled pu^oses and objectives— 

examples when available. 

Procedures, nethod61ogy( What is done, staff requirement, tltne 

involved, and cocnmunity involvement. 

Evaluation: What research wastconducted; what results were 
achieved. 



I ; Person or age\cy tc 



Source of information; Person or agency to consult for more 

Information. 



Life Career frvelopment System 
Human DevelcpmftQt Services 

Qverviev ^ 

Tte Life Career Development Sysfem (LCDS) consists of six 

interrelated cornxTnents that tegfith«t laLke up rdynaralc progr^ of 

career development. Ihe LCDS is cencemed vlth th* development of 

the total Individual and encompasses education, occupation, and 

leisure time. Career decisions and plans are seen in tills system 

as life decisions and plans, and they are considered as an integrated 

developmental sequence involving the goals, values, plans and de-- 

clsions of the individagl now and in the future, Ihe program is 

designed for students from junior high school through college and 

adult, 

Ihe six components are as follows t 1) nine career development 
moduJe of student learning experiencef; ; 2) a Facilitator's Resource 
Bank; 3) a Participant's loimial; A) ore- and post-*A^aluation measures 



5) a facilitator*s training workshop (required of^eaders), and 

6) a LCDS user comnmnication network for sharing across the country 
Goals and Objectives ^ 

Each of the nine career development mo'^ules includes a state- 
ment of purpose, a list of broad goals ^ 'ind a brief description of 

the focus and activity for each session. This outline is listed be- 

} 

low for ilo^le 4, "Expanding Options/' 

Purpose ; /^The purpose of this module is to broaden partici- 
pants* perceptVous of the world of work by helping them to under- 
srand the reas Wq be hind the^e^rgence of new career roles, to* 
evaluate changing work values, t/o develop increased denaitivlty to 
the social ccnse^^uences of career choice^ and to beca©e more aware 
of the wide variety of options available to them* 

Goals ; l^e main goals of this inodule are to help participants 

1, Increase their understanding of new career roles and 
the reasons for their emergence in today's world, 

2, Clarify personal work values, 

3* Identify work values being expressed through new career 
roles, 

4. Become aware of and sensitive to the nature of resistance 
to new career roies, 

I 5* Develop greatetj understanding of the social consequences 
:; of various worlt roles, 

\ L 6, Broaden their thinking about the kinds of career options 
L ■ available to then^. 
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Objectives ^ Participant^ will be able to do the following; 

li Describe six new career roles which have emerged in 
recent years , 

2. Identify four reasons for the emergence of new car^r 
roles* 

3. Identify two work values being expressed in two new 
career roles . 

4. Discuss ways in which their holding a specific/ work 
value might enhance and enrich their lives or/cause 
them difficulties tn the future. 

5. Write a letter of application for eraploymeryt , Incor^ 
'poratlng their reasons for wanting the position "^thelr 

values)* / 

6. State three specific kinds of reslstaocfif which may 
be encountered by persons entering' non-/radltional 
careers . 

'7, List the possible social conse<}uences of two work roles. 
Procedures, Methodology 

The LCDS is focused primarily on participant learnings and 
outcomes! A four-step learning model is utilized which involves: 

1, self-interest arousal regarding goals and objectives; 

2. experience-based learning of life career development 
tasks and problems; 

3. personalization of learning to participants' own needs» 
values^ and life style preferences; 

4, behavlor_al try^ut of new learning and competencies in 
real lift situations. 

The six components of the system provide program dev&liiftgTs o 

leaders with all materials ^ instructiorts and even leadership skilr- 
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training. These components are more fully\.described below? 

1. Nine career deve loptaepr modules ^ Each module consists of 
approximately six to nine 50isiinute sessions ccnnprising indivl- - 
dual aad group structured learning experiences that may be 

used daily, weekly^ in a concentrated unit, or spread over 
seTnetter or a year, |l11 modules are presented by a tralMd * 
career development facilitator who coordinates the learning 
experiences of the participantst 

2. Facilitator's Resource Bank t Each facilitator is provided 

T ■ ^ 

with a two-voX^ume Facilitator^s Resource Bank that gives 1) de- 
tailed Instructions for each module session^ 2) warm^ p exercises^ 
3) specific suggestions for tise at different age levels^ and 
A) enrichment resources^ Worksheets are provided so that the 
module handbooks may be used repeatedly* 

3. Participant's Journal ^ Participants compile their own 
journals as they move through the modules* 'Riese provide an 
ongoing record of personal experiences^ reactions^ and insights 
as they experiment with new learnings and behaviors* Journals 
are a useful vehicle for reference and for sharing new know"* 
ledge and discussing its implicatiofis with peers and parents. 
4^ Pre-'^ost learning measures t Each participant responds to 

a> number of situations before beginning theVodules and again 
at the conclusion -ts a wsry of merrsuring growth in knowledge, 
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skills and attitudes. These pre/post measures provide f^dback 
to the Individual participant concerning what ^^he has 
gained from the programi as well as group '^assessmeot data" 
uaeftrl to educational and coinmunlty decision-makers, 

5, Facllltator*6 training vorkahoR , All career deveXopment 
specialists participate lb a special training workshop which 
familiarizes them with the module content and helps them to ' 
understand and acquire skill iQ presenting the various learning 

; activities of the modules to the participants^ Emphasis Is 
given to helping facilitators acquire a basic conceptual ap-* 
proach to care£^ development which Is consistent with that used 
In the modules * 

6, LCPS User <:ommunlcatlon netvork i The LCDS has been and is 
now being used In a variety of settings and with varied groups 
acrdss the country*' To Insure \hat the experiences and Ideas 

of pfrevlous and present users are optimally utilized, a communl-* 
cation network of users has been established that provides for 
regular sharing of experiences. Through this ongoing sharing, 
LCDS users have a chance to renew or refresh their approaches ^and 
resources « 

Evaluation ^ 

Participant feedback for local evaluation pu^^Mes Is provided 
in the pre^post learning measures, X 
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LCDS is now In the process of being formally evaluated, ^but 
initial data seem to indicate that it is. an effective vehicle for 
positive personal growth. For details of evaluation resuItB write 
to the p^r^eon listed below^ 

Con tact 

Dr. Garry Walz 

tiiman Development Services, Inc. 

P. 0. Box IA03 

Ann Arbor > Michigan 48106 

Bread and Butterflies 

A Curriculum Guide in Career Development , ' , 
197A Agency^for Instructional television 

Overview 

This is a "project'* in career development for nine- to twelve- 

J, 

year-oid^ . The project includes fifteen I5-minute color television - 
programs, a curriculum ^uide > an in-service ^eachers' program, and 
workshop materials. ^ * 

Goals and Objectives ^ ^ " 

Eight broad goals are lifted for the entire series of 15 
programs. Each program has a lesson goal and a list oi intended 
student outcomes. The project goals and those for one prograto^ 
'^Decisions ' DecWiions'* are listed below. 

Project Goals . The full implementation of Bread and Butterflies 
(with its accompanying classroom materials and activities) will help 

^ * * * 
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students to; 



1, Develop a clearer, more positive understanding of self — 
their interests, abilities, values, and interpretations 
of the events in their lives, 

2, Exert greater control over their lives through declsion- 
aaklng and planning. 

3, Develop personal and interpersonal skills and attitudes 
essential to success in school and work* 

Develop greater respect for other people and the work 
they do, 

5, Develop a cleareV concept of successful work behavior — 
the attitudes, sk\lls, and responsibilities demonstrated 
by successful peop\e at school and at work. 

6, Develop skills necesXary to gather, process, and act upon 
information about selTt in relation to a constantly 
changing work envirome\t 

/ 

Relate their immediate eAoeriences and decisions to 
their evolving career development. 

See the connection between sV^hool and the real world; 
understand the relationship between what they learn in 
school and the problems and activities outside the school. 

\ 

LESSON ff4 (Example lesson) ' 
Decisions - Decisions 
Ptogram Goal 

To help students apply the decision-inakin'^ process 
by selecting and explaining a number of hypothetical 
optionsV^aftd^to^elp them discover factors that influence 
decisions and possible present and future consequences 
of given decisions* 
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Example Program (Hitfiomes 

As a result of the lesson^ stjudenf 

recognize that usually th 
choices about what to do 

be able to identify a process for making 
decisions i 

be able to project the possible consequence 
* of various options that affect a decision. 

Procedures , Methodology 

The programs offer brief dramatized versions of the key concepts 
while the guide shows how the concept can be translated into class- 
room activities and related to curriculum are^^ especially language 
artSj mathematics, science^ and social studies* 

Suggested techniques (adult interviews^ on-^the-^job observations > 
workers as resource persons^ home projects, etc.) involve community 
ar>j^ school interaction* Applied learning activities are also pre- 
sented > / 
Evaluation 

The project evaluation was conducted by the Educational Testing 
Service at Princeton^ New Jftrsey^ under the direction of Dr. Saul 
Rockinan of the Agency for Instructional Television. In 1975 a 
utilization research survey was c<mducted in Santa Clara County in 
California. Bread and Butterflies was used as an In-servlce ttaln- 
ing activity for teachers. 
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Most teachers view B read and Butterflies as a s?^gle class' 
activity C81S!) and 94? Indicated that they either always (AAX) or 
often (50%) follow Bjrea d a nd Buttejrf lies with a discussion or 
further Activity. The reinforcement activities related to Bread 
and Butterflies usually last ^ess than 15 minutes > but sometimes 

from 15 to 30 minutes. />lX of the teachers said they h^e the 

j 

teacher's manual for Bread and Butte rflies , and eljnost all of the 

I 

\ 

manual users found It helpful for using the series. 
Contact 

Agency for Instructional Televlsl^ 
Box A 

Bloomlntgton^ Indiana 47401 * _ 

Career Education and Sat ellite Techjiolog y' ^ 1974 



itie Federation of Rocky Mountain States; Denver > Colorado^.^^ 
Overview 

This Is a federally funded project to di^on&trate the feasibility 

\^ and acc^tablllty of a satelllte-baffed. media! dlstrlb>itlon system using 

\ - 

i > 

a variety of program materials In career edt^catlon. Flfty-slx junior 
high schools In eight states participated, iihe progr^ consists of 71 
video broadcasts (35 minutes each) > student booklets > a teacher's 
guldd ^ anfi a serles^^OT 16 one-hour broadcasts of ln-serv^<ie pr^gi 
> for teachers . 
Goals and^^Ob jectlves 

The overall purpose of the program Is ^'to provide the student 



ln-servl<^e pr^gi:ams 

-T 
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.with th$ skUl^^eeded t9^ make po|^tlve and log^^ excisions abou^ 
his or her education and careet based on solid self-knowledge and 
Information about -the world of work." Each of the 71 Student broad- 
casts has a goal statement and a series of activities designed to 
achieve the goal, TVenty-eight student objectives are also lidted. 
Following Is a sample of 15 ; 

Educational Goals of STP Programming \ 

1. Student recognition and acquisition of decision^making 
skills: collecting information; considering alternatives; 
considering outcomes, risk-taking and probabilities > 
strategies . 

2. Student recognition of how assessment affects alternatives. 
3/ Student recognition/of many reasons why people work, 

4. Studenr identifiMtion of some of her/his aptitudes ' " , 
as part of self-assessment. 

5. Student Identification of some of her/his temperaments 
as part of self-assessment. ^ 

6. Student exploration of many careers and some aptitudes > 
interests, and temperamfifits needed for specific occupa- 
.tlpnal examples from the following Dictionary of Occupa" 
ti(ifea-l Titles (DOT) categories: 

' - Farming, Fishery, and Forestry Occupatlona 
Structural Trades . * 

' " Technical, Managerial, and Professional Occupations 

Machine Trades ' , ^ , . 

^ - Service Occupations 

V ' Clerical and Sales Occupations 

Processing Occupations 
Bench Trades 

Mlscellaneoua Occupati^>i^ 

7. Student exploration of how life sty^Jfr-^Jrefefences can 
affect career alternativea. 
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,8. StudfDt exploration of training and/or education 
can affect career alternatives. 

9. Student recognition of the concepts of occupations I 
mol^fllty and specialization. 

10. Sttnifent recognition of Interests as defined by the I^T 
and Interests needed In specific occupations. 

11. Student exploration of the physical demands and vorklng 
conditions associated with a variety of occupstlons. 

12. Student recognition of the history of unions and how 
they work today. 

13. Student recognitt^n that social and cultural changes 
affect empIoyniegV- 

14. Stu4^t exploration of self-^employment possibilities, 

15. Student exploration of the skills required to be a 
knowledgeable consumer. 

Procedures ^ >^ Methodology 

Programs are broadcast every day to receiving classrooms via 
satellite. Following the teacher's guide and utilizing the student 
booklets^ teachers follow up with activities^ discussions^ and 
assignments. Regular classroom teachers participate and may use 
as little or as much sddltlonal time as desired. The community Is ^ 
Involved to the extent that teachers follow the community-based 
activities *sugg;ested. 

Topics of the program Include self-assessment, vslues and 
strategies In decision making. Information about occupations In the^ 
DOT, 1^ ecoVogy/envlroment Impact* on csreers, unions, job security, 
leisure, effei^ts of Social and cultural changes on the world of work. 
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Evaluation 



^E^lM*lon now teing ^condroted art both <he 'use* of tfechrrolog^ 
and the achievement of progy^am objectives. Field best roeearch was 



conducted on all aspects p^lor to the expe^lm^ 



:al yeatf 1974-75, 



For lnforaatiot|^ regarding the avallablllt)( of * evaluation" results > 
write to the person listed below 



r 



Contact^ 

Dr, AI^M^illlams 
Content Coordinator 
Satellite Technology Demonstration 
Federation of Rocky Mountain States 
Suite 300 B 
2480 West 26th Avenue 
Denver ^ Colorado d02 II 
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Decl fll ons ^ an d Out comes , 1973 
College Entr£ttice Ex aminat ion B oai^d, Hew York 



Overview 



This is a program designed to teach senior high and college age 
stiidents the skills of decision making* It Is. packaged In the form 
of a student booklet with a leader^s guide, '^Is version Is a 
follow-rup publication to Deciding ^ a slmlllar program for junior 
high students, ' 
Goals and Objectives 

The content of the program 1« divided Into three major units 
or purposes s . 

I - 



I 
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1. The examlQdtlon kid recognition of pftrsoaal vdluV^; 

2. ^Knowledge and use of adequate^ relidhfle Information; 

3. Knowledge and use of an effective strategy for action. 



Each unit Is a series of exerclse»^ actl^vltl^ and discussions 

with Its Qvn purpose or objective. Some\exampIes ^ollotf ( 

definition of what makes q^clsions' Important 

dlstlnctijon between a good deyclslon and a good outcome 

recognition of the ImportaT^e of values In the 
decision process 

- recognition of the re on between values and 
, ' behavior ^ 

precision In waiting ^tfjjecrtlvea 

under^t aiding of risk-taking In decision making 

Inf orma^on-^collectlng skills 

utilizing experience as Information 

predicting possible outcomes 
Procedures > Methodolog y ^ 

This program Is designed^ as a curriculum tj^be taught .In group 
guidance or cladsroom sessions frc^ short minlfrcouteev td full Semester 
courses. A leader skilled In group leadershl]^ Is required ^ ^ Training 
sessions for leaders are provided by the College Entrance E3^amlnatlon 
Boards 

The procedures Involve ^simulations » roIe-pIaylng» group exercises 
and discussions. Individual activities are suggested and other sources 
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of group activities are cited, student workbook is not intended 

to be a lock-step curriculum but a guide to. student activities* The 
Leader's Guide provfdes precise directions for each exercise as well 
as suggestions for adaptations. 

Evaluation 9 

' "Feed l?ack'' activities, both formal and InfonuaZf are suggested 
in the Leader's Guide as a kind of evaluation for leaders. Other^ 
more precise^ evaluation measures would come from assessment of the 
degree to which leader's objectives were attained^ However » iastxu- 
ments are included in the Guide for process evaluation/ middle and 
early course evaluation and end^of ^"course evaluation, 

Decisfons and Outcoine s is built upon the success of Dcciding ^ 
which was published and evaluated earlier. For a*report of an evalu- 
ation conducted with student users see ^'Students Evaluate Deciding** 
by Gordon Miller, in Coll ege Board__Review H o. 86, 1972 . 

Contact 

Mr. Gordon Miller i 
, Program Service Officer 

College Entrani^e i^eainat;ion Beard 

88B Seventh* Avenu^ '. ' ' ■ 

N Kew York, New York 10019 
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and Career Edu c at iop Betwd^ and P^rocecges^ 1974 

^fee^Qjratora of tbe. Uoly^^lty of Mitfacurl 
^ Col«M a / rSii eouVl ' ' 

Overvlev 

Element* of an Iliufitratiye PrograarOuide Is a systematic col- 
lection of suggestloas to assist leaders to develop aiid Implement 
career guidance p counseling and placement ^ograins^ 

Concepts, goals and objectives and procedures for achle+lng them 
are discussed and outlined for grades K^I2. Chapters^ I an^cl pro- 
vide a rationale and a model for program development. TWo jpp^ndices 
contain examples of goals, objectivep, sample activities anc^^ selected 
resources , ^ 

Methods and Proceases Is a companion set of materials consisting 
of two major components--^ methods and processes guide and ^ system- 
atically organized series of teaching modules for gri^des K-12, 
> 

Coal^ and Objectives 

The Illustrative Pregram Guide speaks to the sequential rela- 
tionships that exist between concepts, goals, objectives and acti-^ 
vlties. These activities b^ecome the processes through which goals 
and objectives are Attained* Objectives and activities are broken 
down Into age or grade levels: , 4-6, 7-9, 10*12* An example 

of one concept Is provided In the following illustration: ■ 
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Domain ; 
Self 



Conceptf 

As members of society people iaterrelate. 



^ Goal 1.3t 

For Individuals to be able to 
communicate openly with others. 



Dev, Goal 1.3: 

For individuals 
to understand 
the value of ex- 
pressing their 
feeling in a 
socially accep- 
tably' manner* - 
n I ~ 



Objective 1,31; 
K-3 

Individuals will 
Identify their 
feelings in a 
variety of sit- 
uations . 



Activity: 

Focus fCit 
Stage One; 
Awareness 



Dev, Goal l,3t 

For individuals 
to understand 
the need to es- 
tablish relation- 
ships with 
o thers * 



Objective 1 .32 : 
A-6 

Individuals will 
identify ways in 
which others are 
able to help thetn* 



\ 



—h- 

^Activity: 

i 

Working Together 



I 



Bev, Goal 1,3: 

1 4 
For individuals 

to understand 
the role commun- 
ication plays in 
interpersonal re- 
lationships , 



Objective 1.33; 
7-9 

Individuals will 
describe hov they 
react to the 
verbal communi- 
cation of others. 



Activity: 

Interpersonal 
Comamnl cation 
Skills 



1 



Dev. Goal 1.3: 

Jor individuals 
to understand 
the value of open 
coomunicatlon. 



Objective 1.34: 
1 10-12 

Individuals will 

describe how open 

communication 

facilitates 

interpersonal 

understanding. 



Activity: 
Peer Counseling 
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Xhe following la an example of objectives and learno^ activities 



found In one module from thes Car^r Editcatlon Methods ^d Processes* 

f 

The module Is Jntltled '^ou* Who, Where^ When" and Is for develop- 
mental level 4^6* . ^ — - 

Learning- -ye'qu-ence number three* 
A. Objectives 

The- learner will differentiate between natural and crisis 
* events. The learner will describe himself or herself In 
terms of "happenings'* and how he or she hss changed through- 
out fife. 
Sequence Overview 

The term ^'events*' when used to designate ari element of one's 
career Includes both natural events that make up the stages 
of s life span and ^?ren£s/ that osy be considered crisis or 
once-ln-a-llfetlme happenings, Within this module, atten- 
uation Is focused on awareness of time and chsnge. The learner 
will better understand the meaning of an event, or occurren^, 
by looking at the ensuing effects — time, growth, change, 
deve lopment , " , * 

C. Learner Activities 

A record of our year ^~ a classroom scrapbook-dlary 
Patterns --^ rhythmic movement, role playing^ oral expression 

What Is a time line? — Interviewing to dev^op a person*s 
time line of life ^ ' 
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My own time line develop tlae line of my Entire Ijlfe 
Procedures, Me thodology aa< l gy^lua^l^n 

Because the Illustration Propratt Cufjig^ Is a collection o jTsug- 
ge&ted student activities designed to meet certain objectives, the 
procedures and methodology depend on which activities are chosen* 
Activities range from teacher^led discussions to using the DOT« to 
role play, peer counseUng^ community Interviewing and post-secondary 
placement procedures . 

Evaluation procedures Involved the revision <if the Gu .lde 
through review by expert consultants f ram ^y 1973 to the presenf 
publication* _/ 

The Career Education Methods ahd Processes student modules In- 



clude developniental learning actlvljtles based on the Career Education 
Model described earlier. Methods Include such activities and exer^ 

clses as Infusing values clarlflcaqlon^ creating and facilitating 

I 

classroom climate, discussion groupjs, role playing^ and world of work 
exploration. Since most of the modules aip In the Initial stages 



of development, no evaluation data ^re currently available on them. 
Contact 

I?rs. Norman Gysbers and Earl Moore^ Editors 
Orte Hill Hall 
University of Missouri 
Columbia, Missouri 65201 
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Baltimore Pl^cenrent and Follw^up Program 

Case_Studl^s_ln_P^ 

3un^ 1973* AmerlcaiT Initltutei- for 

V 

Overvlev 

^ This program provides placement and follow-up services to all 
graduates and drop outs In the clty^s public secondary schools, Cen- 
tral office coordinators offer the service and aake available ^ 
variety of occupational guidance materials to students^ About one 

half (4>000) of the &F«tttt^tes and drop outs take advantage of these 

4 f 
£eI^lc£s aad' materials, Ij^rk-^tudy programs are an additional service* 

Goals and Objectives 

The program lists 38 s^M3 and objectlveff> phrased In terms of 

what thjfe coordinators will doV^For example: 

1p To make students amre of the free service placement, 

2, To assist students In vocational and occupational 

Information* ^ 

3t To assist students to make adjustments during their 

. _ . Initial job entry* 

The student outcome expecTeitMs-^tliat each participant will find 

employment commensurate with his/her abilities and intereatsT 

Procedures. Methodology 

Thrlty-flve placement coordinators are employed In the secondary 

schools and education centers and by tt^ central office. The central 

staff Is led by the iepartment Head of Placement who Is supei^ised by 
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the Supervisor of Job^rlented Programs and Placement, The central 
office staff also includes coordinators of 1) distributive educa-^ 
tlon and food services, 2) apprenticeship programs, and 3) health 
careers. Placement ha(^ been an objective of the guidance division 
In Baltimore since 1928. 

Students are acquainted with services through assemblies and 
closed meetings, ^Many students also participate In job readiness 
sessions taught by coordinators. Coordinators contact and work with 
employers and develop close cooperation with civic and community 
organizations. / 

Evaluation ^ 

i 

Yearly program evaXuatl<m reveals that approximately 75Z of 
students seeking full->time placement are placed^ In 1971^72 there 
were 3,626 full'tlme placements as a result of the program. In 
addition, 2,417 part-time placements and 2,326 temporary and summer 
placements brought the total number of placements that year to 
8,569. / 

Every student Is contacted at Intervals of three months, six 
months, and one year after placement* Follovup with employers la 
al&o conducted. 



For more inf ortiatl6n7"^*hft^ra^tire case study report can be 
found In Educational Resourc*r^-Ia£ormatflon Center (EMC) 
(ED 076 927). 
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or write tot 

Department Head ^ ^ 

Placement and Follow^p Progpfim;-:^ ;^<ot^ 
Baltimore Public Schools 
Baltlm^re^Maryland 21218 



Job Development Program ^ Cleveland Public Sc hoo Is, 

Case Studies in Practical Career Quldancet Number 9 
June 1973^ Americao^ Itistitutes of Research^ 

Overview 

This is an alternative program offering guidance and placement 
assistance to students seeking employment on completion of high schools 
These students are non^college bound seniors from the five Inner city/ 
high schoo^ls. The program emphasizes: 

1. ~ Guiding students to make decisions l^bout their^ 
career goals. " 
Assisting students to develop and maintain basic 
skills needed for their career choices^ 
3, Finding jobs for all graduates at the job-entry 
level* ^ 
Goals and Ob_1ectlves 

The overall goal i,s to assist Inner city high school students 
In finding gainful, full-time employment after graduation^ 
The program provides: 
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1. 

2. 
3. 
A. 
5. 
6. 



job development and placement serviced 
Instruction. In seeking and getting a' job 
orientation toNhe world of work 
vocational counselfh|^ 

referral to educatlonal\and training opportunities' 
Interviews with businesses 
Counselors help students become: ,( 

1. less fearful In job Interviews 

2. more aware of their own strengths and weaknesses 

I 

3. more Informed^ on job seeking techniques ^ [ 

4. more knowledgeable about the obligations and \ 

^ ! ^ , 

responsibilities of empToyment 

5. better acquainted with the world of work 

6. more positive In attitude toward employment 
Procedures > ^Methodology * 

The Jofc Development Program ^ploys five fully credenti^ed 
counselors. These full-titfe counselors spend 35% of their time In 
Individual cj^unsellng; group counseling takes up about 12t of their 
time* An additional 35Z of tt\elr time Is devoted to such tasks^^as 
consuIt:^ng with other educatjfonal personnel ^ serving In coiamunl^y 
liaison roles^ planning and evaluating program activities^ and a^ln^ 
Istratlve duties. The remaining iOX of the counselor^* time is 1 
^evoted to identifying students* eligibility for job placei|^nt^ 
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Five paraprof esslonals arkalso employed. Approximately half -of 
their time is spent in coinmunityXlidison roles and another large part 
tn working directly with students. 

Facilities and materials are located in each of the five high 
;sQhools and at the Board of Education building. These locations 
^a re Known as the **Job Placetnent Center/' 
Evaluation 

Evaluation data collection has focused on the number of students 
placed. 1 

Pl&cement over ti^^past six yOars has been in clerical occupa- 
tions > service occupations^ skilled and manual occupations^ and sales 
occupations. Only 18X of the graduating seniors placed six years 

y 

ago were no longer employe^/. 95% of the June, 1972> graduates parti% 
cipating in the prograip wer^^laced. 

Contact ' ^ 

Dr. Donald Hoelas 

Director ; ^ ' ^ 

Technical"Vocatioctal Division 
Cleveland Public Schools 
1380'East Sixth Street 
Cleveland, Ohio 44114 ^ ^ 
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;e<l Llstvof fitrategy Sources 
The follovlng are listings of materials or activities for 
potential career guidance strategies. 



I. 



2. 



3. 



A. 



5. 



Resource Book of- low X3o<Ht\^tertel8^ American Institutes 
for Research/ 197V/ 3bx^ 1113/ talo Alto^ California 
94302. 

A review of teacher handbooks and guides; career exploration ^ 
Curricula and stildent texts; student guidance materials; and 
ntultlmedla resources* Also Includes annotations of otller 
bibliographies^ journals, etc.; a survey of children's llter-^ 
ature on career education; and brief notes of re/ently fudded 
federal projects. 



Resource Book of Sample Units , American Institutes for 
Research/ 1974, P.O. Box 1113> Palo Alto, California. 94302. 

This resource contains IS lesson units that teachers might 
use In the Introduction of career education into their class- 
rooms. The units cover gr&des and are Intended to serve 
as examples of units teachers might develop themselves. 

Review of Career Education in Secondary Education » College 
Entrance Examination Board > 1973. 888 Seventh Street, Rew 
York,^N.Y. 10019. 

A systematic reviewof development In secondary guidance In 
career education. This volume contains a description of 
trends and of exemplary guidance materials^ projects and 
programs nov In use or development. 

Career Guidance; A Handbook of ttethods , Merrill Publishing 
Company, 1973. Columbus, Dhlo 4y2l6. 

Career Education Resource Oulda ^ General Learning Corpora-* 
tloh, 197^. 2450 Embarcadero Road; Palo Alto, California 
94305 

This guide iff not Intended to be a comprehensive career 
education program. ' It, Is a collection of activities that 
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can be Initiated and carried out by teachers, K^adult. 
The activities are s^If-^contalned curriculum elements , 
selected and adapted las provocative claasroom models. ' 
Materials and activities are organized according to per- 
.formance objectives, ■ 

Career Guldance^^ CQunBeMng and 'Placement Elements of an 
Illastratlve' Projeram^ j^j^j^X ^<>™aQ Sysbers and Earl Moor^ 
(Eds\)^ 197 4\ 'itaiverVlty of Missouri, Columbia, Missouri. 

Chapter 3 lists career guidance goals » objectives and 
strategies for achieving them by grade level. Appendix 
B presents^ sample guidance strategies for goals and ob-* 
jectlves In each of four basic doftialns; Self Domain; 
Llfp Roles, Settings and Events Domain; Life Career Plan- 
nl ,^ O.jmaln; and Basic Studied and Occupational Prepara- 
tlou Domain. i . 

Case Studies In Practice Career Guidance , American 
Institutes for Research, 1973. P.O. Box 1113, Palo Alto, 
California 94302 

This Is a series oi 13 case studies which vere written as 
part of USOE contract; Practical Career Guidance, Counsel^ 
Ing and Placem ent for thisv Ko hgolleiee*&ound Students > Other 
products Include a revlew^^f the literature and final re- 
port which butllnes a plannlng-evaluatlon model for develop 
Ing local career guidance programs. All these products can 
be obtained through ERIC. Their respective ERIC numbers 
are listed belkiw. 

1. Baltimore Placement and Follcw-up Program_ 
^Baltimore City Public Schools 

Baltimore, Maryland , (ED 076 927) 

2. Career Development Center 
Troy High School 

Fullerton, California (ED 076 928) 

/' 

3. Career and Educational Planning Program 
Pioneer Senior High School 

San JPse, California (ED 078 332) 

4/ Careec Guidance Program , 

Hood River Valley High. School 

Hood River, Oregon (ed 078 333) 
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5, Computerized VocatloOal Information System 
Wlllowbrook High School 

Villa Park, Illinois (ED 078 334) 

6, Coordinated Vocational and Academic Education 
North Gwinnett High School 

Suwanee, Georgia (ED 078 335) ' 

7, Developmental Career Guidance Project 
Detroit Public Schools 

Detroit, Michigan (ED 078 336)" 

8, Employabillty Development Team 
Cleveland Public Schools 
Cleveland, Ohio (ED 078 337) 

9- Job Developmeat Program 
Cleveland Public Schools 
Cleveland, Ohio (ED 078 338) 

lO/^ Kimberly Guidance Program 
Klmberly High School 

Kimberly, Idaho (ED 078 339) 

11, Lenawee Vocational-* Technical Center and 

Placement Program 
A<h^iaa^ Michigan (ED 078 3A0) 

12, " Occupational Learning Center 

Syriicuse City School District 
Syracuse, New York (ED 078 3Al) 

13, Youth Career Action Program 

San Jose Unified School District 

San Jose, California (ED 080 078) 



Practical Career Guidance^ Counseling, -an d Placement for 
the Noncolleg e^Bound Studentr A Revie w of the Literature 
(ED 080 919) - ^ 

Planning! ^^^"^5 ^ ^ ^£,^^5^ > apd E valu ating Practical Career 
Guidance Bpr Ih^gratlon Vy fJ^ocoH^e^ Bou nd Vouth (Final 
Report) (Eb 082^73) ^ | 
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Therafey tic\T^^^l< ^ Woyklm, Mo^ for the ttelpln^ ^ 

PersbnheT and Guidance Association^ I973# 632 Commort- 
wealth Avenue^ FuIIerton| California 92631. 

This entire book of 16 chapters describes Intervention tech- 
niques which can be. thought of as broad counseling strate-^ 
gles for guidance purpos^^Si Successful working model^ are , 
described for helping Individuals achieve a reasonably 
positive self-concept, a sense of agency, and decision- 
making abilities. 

In addition^ for those who want to do more In-^depth reading 
related to the topics of this chapter, the following may 
prove useful t 

Campbell, R. E,, Walz, G, R. , Miller, J. V;, Krlger, S, F,, 
Career Gui dance t A Handbook o f Methods > Columbus, Ohio: 
Charles E*'Merrili"PubIlshlng Company, 1973. 

Chapter #4, Types of Career Guidance Methods. This 
chapter lists eight types of career guidance methods and 
discussed factors affecting the selection of methods, . , 
The eight types are; 

a) , behavioral approaches 

b) computer assisted counseling 

c) educational media - p 
' d) ,group procedures 

e) Information systems , * 

f) slrtulatlon gaming 

g) vocationally relevant curriculum 

h) work experience programs 

Chapter //5- Designing Career Guidance Approaches. This 
chapter Is written to provide a\framework for translating 
the needs of students Into guidance goals and for designing 

^ tailored career guidance approaches which can help Imple^* 

J ment these guidance goals. The chapter focuses on; 

a) presenting specific successful guidance approaches 

b) helping the reader determine If the approach would 
meet student needs of his district 

c) providing basic principles which govern the nse of 
the approach 
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d) providing concrete steps needed to design^ Implement^ 
evaluate and revls^ an application of the approach ^ 

Chapter #6, Guidelines for. Career Guidance Program Develop- 
ment. Ihls chapter deals with total guidance programs 
rather than' individual career guidance methods^ It In-- 
cipdes discussion of the following concepts which are re- 
levant to this module ^s toplct 

, - ^ 

^) specification of alternative strategies 

b) program mission and accountability 

c) procedural parsimony 

d) maximizing resources 

Jones^ G* Ganschow, H^^ Helllwell^ C. B.^ Wolff » 
J, M., Dayton, C, A Manual for Iteveloplng Cateer 
Guidance Programs Irvine; California: Educational 
Properties , Inc. , 1974 . 

This manual Is designed to teach the #kllls o|Sprogram 
development. Chapter Three^ Structuring and Implementing 
Programs r has content relevant to selecting guidance 
strategies. 

Herr, L» , & Cramer, Stanley H. Vocational Guidance 
and Car eer Developineo t in the Schoo ls t To wa r d a Systems* 
Approach . PaloH^Jto/ Calif ornla: HouglTton Mlf flin Co/. 
1972. 

Although the entlrfe book is relevant to developing a 'com"* 
prehenslve career guidance pro^ram^ Chapter 9> Helping 
Strategies in Vocational Guldan^^, is of particular inter- 
est* Ihe author ^divides strategies into Indlvldtialr ^ 
group, and^ejfviromental treatment. ^ Each of these types 
of helping strategies is discussed in terms of their 
relevancy tor career guidance in the schools. 

Stuff lebeam, D, L#; et al • Phi Delta Kappa National fetudy 
Committee' on Evaluation, Educational Eyaluatimi and Decision 
Making , Peacock, Itaska, Illlnoislt thl t)eTta Kappa| 1971/ 

Chapter 3, Educatlot^al Decision Making; and Chapter 4, ^ 
Criteria, are* particularly relevant to selecting strategies, 
A technical, detaiield but uaeful djlscusslon of the process^x 
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of choosing and the, criteria for choice is Included, l^ese 
chapters voujld be helpful to an advanced -student looking for 
a^icb more intellectual diacusslon of the topics. 

5, Miller* J. R, Professional Pecieioo Making . New York; 
Praeger Publishers, Kew" YbrkV 1970\' ' 

The subtitle of this book is "A Procedure ^or Evaluating 
Ccraplex Alternatives < It is written for *OTDplex business 
decisions but has application to this topic. It is highly 
technical^ of interest only to an advanced student. 

6, Kelley, Marjorie L, Planning ai^i Design: *Th& Consideration 
of Alternatives^ Module 2 , San Francisco, talifom'ia; 

Far West Laboratory for Educational Research and Development, 
1971, 

This is one module in a sequence of modules written for 
the educational developer. It outlines a pattern of 
operation to follow when considering alternative ways of 
reaching educational .objectives. Good examples are pro- 
vided and practice exercises &re given to apply the skills 
learned . 
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Chapter V 

-^.=^^.. Suncnary and Conclusion 

We have covered a good deal of ground In this discussion, Per* 
haps a brief recap would be In order, 

Cnapter I, "The Seed for More Systematic Program Planning and 
Evaluation/' began by surveying some of the pressing problems facing 
human services programs today. I^ese Include the funding crisis In 
social and educational Institutions, the crisis counseling syndrome^ 
and the demand for accountability accompanied by human services per- 
sonnel bewilderment Iq the face of this demand/ All of these factors 
become serious problems for huiDan services programs, While a variety 
of possible answers exists^ one particularly hopeful resolution reste 
in a systematic planning and evaluation approach, AIR has been work* 
ing ovet the past two years to develop a competency-based staff 
development program to provldejt^hose working in human services with, 
the knowledge and skiJ^ls needed plan^ d«velop> Implement^ and 
evaluate comprehensive programs of guidance* counseling, placement* 
and follow-through, Ihls approach has a number of advantages and 
disadvantages, and Is presently being researched to determine whether 
It will fulfill Its promise,- 

Chapter 11^ "An Approach to BffectWe Program Planning and 
hvaluatlon detailed -this planning ,ind evaluation approach > par- 



ticularly Its planning phaee * Conducting desired outcotaes aasees-. 
ments^ performing current status asse6Sment8| eatabllehing program 
goals, and developing client ptrfonumce objectives were all delved 
Into in some depth. Examples of activities and products Involved 
in each of these tasks were presented* ftie remaining activities in 
the overall model for program development vere then briefly sumna- 
ri2ed. These Include: 

Selecting Alternative Program Strategies 

Specifying Process Objectives 

Developing Program Staff 

Trying Out Activities and Monitoring Early 
/ ' Implementation Efforts 

Conducting,^ Summatlve Eva Rations (Cost-^Impact Studies) 

Ccmimunlcatlng Evaluation Results 
Chapter "I>eveloping Staff Skills for this Pltpning- 

Evaluation Model and Process/' described the program of -staff develop- 
ment that has been developed at AIR to help those worKlDg^ In h^ao 
services to acquire the l^owledge and skills needed to' carry out such 
program Improvement* IncluTled was 9 dlstusslon of some of the phllct^ 
sophical underpinnings for such staff development* The chapter then 
detailed the nature and focus of the program^ and related this to 
general counseling skills* The. format of the modules was presented* 
Each module Is structured around precise objectlvea^ and Includes all 
the follcwing: an introductory section that outlines the module and 
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Indicates how It fits Into the overall model^ a glossary^ text; 
discussion questions^ practice activities^ a postassessment; a per- 
sonai application activity^ and an appendix coritalnlng possible 
additional readings, an optional slarulatlon description, and a Mb- 
liography of additional resources related to the topic of that 
particular moduXe. Finally^ the outcomes to be achieved by all 
the modules were presented. 

Chapter IV, /'Using Competency^Based Client Strategies and 
Materials/' surveyed some of the programs now existing and described 
how these could fit Into treatment strategies designed around the 
planning and evaluation approach detailed above. The following 
programs wer6 b^efly described: 

The Life Career Development System 
Bread add Butterflies 
Career Education and Satellite Technology Demonstration 
Decisions and Outcomes ^ 

~ '; Career Guidance, Counseling^ and Placement Guide 
and Career Education Methods and Processes 

Baltimore Placement and FolTowp Program 

Job Development Program—Cleveland Public Schools 

Finally^ an annotated list of resources was presented, summarizing 

many additional wellsprlngs of Information and Ideas for client treat' 

i 

ment strategies and materials useful with any well-plai^ed and 



evaluated program. 

One additional related AIR effort should be mentioned here. 
TMs is a catalog of competency-tased staff development programs 
Misting throughout the United States, As part of the project that 
developed the education program described in thia document^ a 
national search was conducted to learn wh^t other approaches existed 
that would be useful in developing human services staff skills, 
tfhile the results of this search were not overwhelming^ 34 other 
programs were described, many statements of desirable competencies 
for those working in this field were abstracted, and a catalog 
summarizing this information was produced. AIR plans to continue 
this search for another year, adding to its curreat discoveries 

and compiling a comprehensive resource useful for anyone interest^ed 

* 

in furthering the kxiwledge and skills of those working in guidance* 
counseling, placement* and f ollw-through . 

Let us close with a hopeful thought. The possibilities to 
which human services programs can look, given imaginative leader- 
ship and hard work, are boundless. The services they can provide 
are invaluable- At no time in the past have the challenged been 
greater or the potential more limitless. The approach described 
in this document rep^sents one attempt to help meet those chal- 
lenges and experience the fulfillment of that potential. To those 
interested, we offer It as a tool in that effort. If it can help 

/ 
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Hansen, J. C,, & Herr, E. L, The fpllowr-up study, Irr Research 
guidelines for high school cpun ee lors , New York: ' College 
Entrance* Exainlnatlbn" feoariV 1^66"/ -x*. . , . . ^ 
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Prentice-Hall, tnc, 1970, 

* If you would like more Information on particular assessment 

techniques, see the followingt 
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J. 
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If y^u want to know toore about the concept and measurement of ^ 

career maturlty/developjaent* see the following: 
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models and programs. In H, Borow (Ed;), Career gul(]aDce for 
a new age, Boston: Houghton Mifflin ,C(^4Ay; '1973; ^ ^ ' ' ' ^ 



^ EstabllBhln|i Program Goals 
While a great deal haf^^een written about behavioral objectives, 
surprisingly little is easily available on the topic of establishing 
goals, James Popham and Eva Baker > teachers In the InfitructioPal ob- 
jectives fields have published Estayilshing Instructional Goals 
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(Englewood Cliffs, New Jersey; Prentice^all, 1970), but it deals 
with objectives far more than goals* Robert Mager, another expert 
in developing objectives, also has a book on goals. Goal Analysis ^ 
(Belmont, Calif,: Fearon Publishers, 1972), which is somewhat more 
directed at goals, but still largely focuses on objectives- The 
works of Benjamin* Bloom and others are helfpful. They are taxonomies 
of educational objectives, one in the cognitive and one in the af- 
fective realm. They are referenced in the (\^xt section of this 
bibliography, as Is^ the work Frank Wellman produced on a similar 
taxonomy for guidance-related objectives,. 

General reference works may provide some assistance; for example 
books such as Stephen Isaac's Handbook in Resea rch" and ^valuation 
(San Diego: Robert Knapp, l97l)- Finally, the series of California 
monographs published by the California Personnel and Guidance As- 
sociation often touches on goals- These six monpgraphs are: 

No, 1 — Stating the goals of counseling (1966) by. 
John D- KrumDoltz- 

• No, 2 — Eva luating p "2.j^l personnel programs (1971) by 
Robert W, O'Hare and Barbara Lasser- 

No, 3 Accountability .in pupil per sonnel services: A 
process gu id e for ^ the d.evelo pment of objectives 
(1971) editTd'Vy Howard J- Sullivan and Robert 
W, 0*Hare, 

No* k tr A master plan for pupil services (1972) edited 
by Anita M,/Mitchell and James A- Saum. 



So, 5 — Career dwelopmentj A California model for career 
g uid ance^ currioulma»^ Wadul t (1972) edited by Jo€ 
Cunh a , Darry"! ITramoVe'/ Bruce Lovrey, Anita Mltchellj 
Thomas Smith, and Dale Woolley, 

No, 6 — Result sy s t^ma_ mana^men t ; The human side of ^ 

accoun tat iU^ (iVtT) >)y David Keirsey and Marilyn 
x\ Bates , 

Q ^ ■ 

Monographs are available from California Personnel and Guidance 
Association, 654 East Commonwealth Avenue, Fullerton^ Calfomia 92631, 




Specifying Leamer Perfortaance Object^ 
A very good overall text oo the subjecf of writing learner per- 
fonnar.ce objective^ is; 

Klbler, R, J,, Baker, L, L,, h >U:es, D, T, (Eds,), Behavioral 
objectives and instruction , Boston; M^yn and Bacon , Inc , , 
1970, 

For information on the types of objectives^ try reading; 

Bloom, B, S, (Ed,), Taxonomy of ed ucational qbj^actives. Handbook I; 
The cognitive d omain. New York^ Longmans, Green and Company, 
1956, 

Kra thwohl, D, R, , Bloom, B, S , , h Masia , B, B, (Eds , ) , ^ Taxon<imy of 
educational objectives, Handbool& II; Affective dotnain. New 
York; David McKay Company, lnc\ , 1964, ^ " 

Popham, W, J,, et al. Ins tructional objectifies: American Educational 
Research Associ ation Mono gr aph ^e r ijjrf .-^n Curri culum Evaluation , 
Chicago: Rand McNally and Company, i969. 

For discussions on the purpose of writing objectives and their 
correct form', see; 

Krumboltz, J, D, St^at ing the 'goals of c ounseling, Monograph No. 1, 

Fullerton, California^ CalifornTa^l^ersonnel and Guidance As- "7 
soclatlOHi 1966, 
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Lindval 1 , C, M, (Ed , ) ' Defining educational objec tives; A report 
of the Regional CoTO iecioD oa Educa tiooa^ Coordination and the 
Learning Researcb ao'd^lj^elopi&eQt li^terT Pittsburgh: Uni- 
versity of PittsbuVgF FrTss/ IV64V 

Mager, R, F, Preparing instructional objectives ^ Palo Alto, 
Calif,; Fearon PubllshersV 1'96Y, ' " 

The following contain many examples of objectives; 

IXjnn J J, A,, et al, Care&r education ; A curr iculum design and 

Instruction a l objec tives £at^aiog_^ Palo Alto, Calif, ; Anerican 
Institutes for Research, 197^, 

National Assessment of Education Progress, Objectives for career 
anc occupat ional de velopment < Denver; Author,- 1971, 

rtelimarij F, E, A conceptual framework for the derivation of 

guidance objectives and outcome criteria; Preliminary state- 
ment. In J, Wnlteley (Ed,)^ Research in counseling, Columbus^ 
Ohio; Charles E, r.errlll, 1967, 

Ihe references below have more general information^ but they 
contain parts which are relevant to the writing at learner performance 
objectives , 

Briggs, L, J, Handboojc o^f procedures for th e design of instruction , 
Pittsburgh; American Institutes for Research, 1970, 

Crawford, J, (Ed,), CORD n ational research tra ining manual (2nd ed , ) , 
' ^ Eugene, Oregon; Teaching Research Division, Oregon State 
System of Higher Education, 1972, 

Far West Laboratory for Educational Research and Development, Ihe 

S£^ecif icatlon o f expecte d outc omes > San Francisco; Author, 1971, 

Herr, E, L, , & Cramer, S, Vocatio nal guidance and career develop- 
ment in the schools ; Towarjd^a^sys teni^s^ap^oach , Boston ; 
Houghton Mifflin Company, 1972- 

Jones, G, B,, U\yUf, J. M,, et al. Specifying produc t and proces s 
objectives J M odule 2, Palo Alto, CaTlT, ; AmeVlcan Institutes 
for Research* 
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P^pham, W,, & Baker, E. L, Systematic instruction. Englevood Cliffs, 
Nev Jersey: Prenticet-Hall^ Inc., 1970. 

Shaw, M, C. School guidance programs. Objectives, functions, 
evaluation^ ^nd change. Boston: Houghton Mifflin^ 1973. 
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